Aug 28 20:04:49 devstack cinder-volume[75076]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 20:04:49 devstack cinder-volume[75076]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 20:04:49 devstack cinder-volume[75076]: we strongly recommend against using it for new projects. Aug 28 20:04:49 devstack cinder-volume[75076]: If you are already using Eventlet, we recommend migrating to a different Aug 28 20:04:49 devstack cinder-volume[75076]: framework. For more detail see Aug 28 20:04:49 devstack cinder-volume[75076]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 20:04:49 devstack cinder-volume[75076]: import eventlet # noqa Aug 28 20:04:52 devstack cinder-volume[75076]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 20:04:52 devstack cinder-volume[75076]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 20:04:52 devstack cinder-volume[75076]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 20:04:53 devstack cinder-volume[75076]: INFO dbcounter [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Registered counter for database cinder Aug 28 20:04:53 devstack cinder-volume[75076]: DEBUG oslo_db.sqlalchemy.engines [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:04:53 devstack cinder-volume[75076]: DEBUG dbcounter [-] [75076] Writer thread running {{(pid=75076) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 20:04:53 devstack cinder-volume[75076]: INFO cinder.rpc [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 20:04:53 devstack cinder-volume[75076]: INFO cinder.rpc [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 20:04:53 devstack cinder-volume[75076]: DEBUG oslo_db.sqlalchemy.engines [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:04:53 devstack cinder-volume[75076]: INFO cinder.volume.manager [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Determined volume DB was empty at startup. Aug 28 20:04:53 devstack cinder-volume[75076]: DEBUG cinder.volume.manager [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75076) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 20:04:53 devstack cinder-volume[75076]: INFO cinder.volume.manager [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 28 20:04:53 devstack cinder-volume[75076]: WARNING stevedore.named [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 20:04:53 devstack cinder-volume[75076]: WARNING castellan.key_manager [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 20:04:53 devstack cinder-volume[75076]: WARNING cinder.keymgr.conf_key_mgr [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 20:04:53 devstack cinder-volume[75076]: DEBUG cinder.volume.drivers.lvm [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75076) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 28 20:04:53 devstack cinder-volume[75076]: DEBUG oslo_concurrency.processutils [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75076) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_concurrency.processutils [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] CMD "cinder-rtstool verify" returned: 0 in 0.551s {{(pid=75076) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_db.sqlalchemy.engines [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:04:54 devstack cinder-volume[75076]: INFO cinder.rpc [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 28 20:04:54 devstack cinder-volume[75076]: INFO cinder.rpc [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 28 20:04:54 devstack cinder-volume[75076]: WARNING stevedore.named [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 20:04:54 devstack cinder-volume[75076]: WARNING castellan.key_manager [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 20:04:54 devstack cinder-volume[75076]: INFO cinder.volume.manager [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_db.sqlalchemy.engines [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75076) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:04:54 devstack cinder-volume[75076]: INFO oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Starting 1 workers Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Started child 75298 {{(pid=75076) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Full set of CONF: {{(pid=75076) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] ******************************************************************************** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Configuration options gathered from: {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] ================================================================================ {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] allow_availability_zone_fallback = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] allow_compression_on_image_upload = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] allowed_direct_url_schemes = [] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] api_rate_limit = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] auth_strategy = keystone {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] az_cache_duration = 3600 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_availability_zone = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_host = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75298]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_name = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_stats_polling_interval = 60 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backup_api_class = cinder.backup.api.API {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backup_name_template = backup-%s {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backup_use_same_host = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backup_use_temp_snapshot = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] chap_password = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] chap_username = {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cinder_internal_tenant_project_id = c8ce0989960d4141a3704ebc6e7e90f9 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cinder_internal_tenant_user_id = b7aea6b640764d1a89b21331770df6cc {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cloned_volume_same_az = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cluster = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] compression_format = gzip {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] compute_api_class = cinder.compute.nova.API {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] config_dir = [] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] config_source = [] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] control_exchange = openstack {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] debug = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] default_availability_zone = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] default_group_type = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] default_volume_type = lvmdriver-1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] disk_geometry = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] driver_client_cert = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] driver_client_cert_key = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] driver_data_namespace = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] driver_ssl_cert_path = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] driver_ssl_cert_verify = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] driver_use_ssl = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] enable_force_upload = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] enable_new_services = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] enable_unsupported_driver = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] enforce_multipath_for_image_xfer = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] filter_function = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance_api_insecure = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance_api_servers = ['http://192.168.122.98/image'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance_api_ssl_compression = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance_ca_certificates_file = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance_catalog_info = image:glance:publicURL {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance_certfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance_keyfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance_num_retries = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance_request_timeout = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] goodness_function = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] graceful_shutdown_timeout = 5 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] group_api_class = cinder.group.api.API {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] host = devstack {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] image_compress_on_upload = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] image_conversion_address_space_limit = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] image_conversion_cpu_limit = 60 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] image_conversion_disable = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] image_upload_use_cinder_backend = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] image_upload_use_internal_tenant = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] image_volume_cache_enabled = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] image_volume_cache_max_count = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] image_volume_cache_max_size_gb = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] init_host_max_objects_retrieval = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] instance_format = [instance: %(uuid)s] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] iscsi_target_flags = {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] iscsi_write_cache = on {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] iser_helper = tgtadm {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] iser_ip_address = 192.168.122.98 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] iser_port = 3260 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] log_color = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] log_config_append = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] log_dir = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] log_file = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] log_options = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] log_rotate_interval = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] log_rotate_interval_type = days {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] log_rotation_type = none {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] max_age = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] max_logfile_count = 30 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] max_logfile_size_mb = 200 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] max_over_subscription_ratio = 20.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] message_reap_interval = 86400 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] message_ttl = 2592000 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] migration_create_volume_timeout_secs = 300 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] monkey_patch = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] monkey_patch_modules = [] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] my_ip = 192.168.122.98 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] no_snapshot_gb_quota = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] num_iser_scan_tries = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] num_shell_tries = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] num_volume_device_scan_tries = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] nvmeof_conn_info_version = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] nvmet_ns_id = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] nvmet_port_id = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] osapi_max_limit = 1000 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] osapi_volume_ext_list = [] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] osapi_volume_listen_port = 8776 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] osapi_volume_use_ssl = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] osapi_volume_workers = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] per_volume_size_limit = -1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] periodic_fuzzy_delay = 60 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] periodic_interval = 60 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] public_endpoint = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] publish_errors = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] quota_backup_gigabytes = 1000 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] quota_backups = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] quota_gigabytes = 1000 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] quota_groups = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] quota_snapshots = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] quota_volumes = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75298]: INFO cinder.volume.manager [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] rate_limit_burst = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] rate_limit_except_level = CRITICAL {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] rate_limit_interval = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] reinit_driver_count = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] replication_device = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] report_discard_supported = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] report_interval = 120 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] reservation_clean_interval = 86400 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] reservation_expire = 86400 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] reserved_image_namespaces = [] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] reserved_percentage = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] rpc_response_timeout = 120 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] run_external_periodic_tasks = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] scst_target_driver = iscsi {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] scst_target_iqn_name = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_down_time = 720 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] shell_completion = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] snapshot_name_template = snapshot-%s {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] snapshot_same_host = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] split_loggers = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] state_path = /opt/stack/data/cinder {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] storage_availability_zone = nova {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] storage_protocol = iSCSI {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] syslog_log_facility = LOG_USER {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] target_helper = lioadm {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] target_ip_address = 192.168.122.98 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] target_port = 3260 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] target_protocol = iscsi {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] target_secondary_ip_addresses = [] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] trace_flags = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] transport_url = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] until_refresh = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] use_chap_auth = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] use_default_quota_class = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] use_journal = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] use_json = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] use_multipath_for_image_xfer = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] use_stderr = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] use_syslog = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] verify_glance_signatures = enabled {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_api_class = cinder.volume.api.API {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_backend_name = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_clear = zero {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_clear_ionice = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_clear_size = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_copy_bps_limit = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_dd_blocksize = 1M {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_name_template = volume-%s {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_service_inithost_offload = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volume_usage_audit_period = month {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] zoning_mode = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_concurrency.disable_process_locking = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.auth_section = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.auth_type = password {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.auth_version = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:54 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.cache = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.certfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.include_service_catalog = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.insecure = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.interface = public {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.keyfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_password = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcache_username = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.region_name = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.service_type = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.backend = dogpile.cache.null {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.backend_argument = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.backend_expiration_time = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.config_prefix = cache.oslo {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.debug_cache_backend = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.enable_retry_client = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.enable_socket_keepalive = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.enabled = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.expiration_time = 600 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.hashclient_retry_attempts = 2 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.memcache_dead_retry = 300 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.memcache_pool_maxsize = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.memcache_sasl_enabled = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.password = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.proxies = [] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.redis_db = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.redis_server = localhost:6379 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.retry_attempts = 2 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.retry_delay = 0.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.socket_keepalive_count = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.socket_keepalive_idle = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.socket_keepalive_interval = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.socket_timeout = 1.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.tls_allowed_ciphers = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.tls_cafile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.tls_certfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.tls_enabled = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.tls_keyfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cache.username = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] coordination.backend_url = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.asyncio_connection = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.asyncio_slave_connection = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.backend = sqlalchemy {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.connection = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.connection_debug = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.connection_parameters = {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.connection_recycle_time = 3600 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.connection_trace = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.db_inc_retry_interval = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.db_max_retries = 20 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.db_max_retry_interval = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.db_retry_interval = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.max_overflow = 50 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.max_pool_size = 5 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.max_retries = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.mysql_wsrep_sync_wait = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.pool_timeout = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.retry_interval = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.slave_connection = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.sqlite_synchronous = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.synchronous_reader = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] database.use_db_reconnect = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_tracing.insecure = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.connection_string = messaging:// {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.enabled = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.es_doc_type = notification {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.es_scroll_size = 10000 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.es_scroll_time = 2m {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.filter_error_trace = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.hmac_keys = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.sentinel_service_name = mymaster {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.socket_timeout = 0.1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.trace_requests = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler.trace_sqlalchemy = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler_jaeger.process_tags = {} {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler_jaeger.service_name_prefix = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] profiler_otlp.service_name_prefix = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_policy.enforce_new_defaults = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_policy.policy_default_rule = default {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_policy.policy_file = policy.yaml {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] privsep_osbrick.group = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] privsep_osbrick.helper_command = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] privsep_osbrick.user = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cinder_sys_admin.group = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cinder_sys_admin.helper_command = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] cinder_sys_admin.user = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_user.auth_section = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_user.auth_type = password {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_user.cafile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_user.certfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_user.collect_timing = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_user.insecure = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_user.keyfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_user.send_service_user_token = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_user.split_loggers = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] service_user.timeout = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance.auth_section = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance.auth_type = password {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance.certfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance.collect_timing = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance.insecure = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance.keyfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance.region_name = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance.split_loggers = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] glance.timeout = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.backend_availability_zone = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.chap_password = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.chap_username = {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.disk_geometry = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.driver_client_cert = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.driver_client_cert_key = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.driver_data_namespace = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.driver_use_ssl = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.extra_capabilities = {} {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.filter_function = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.goodness_function = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.iscsi_target_flags = {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.iscsi_write_cache = on {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.iser_helper = tgtadm {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.iser_port = 3260 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack sudo[75362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.lvm_share_target = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack sudo[75362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.lvm_type = auto {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.num_shell_tries = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.replication_device = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.report_discard_supported = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.reserved_percentage = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.target_helper = tgtadm {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.target_port = 3260 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.target_protocol = iscsi {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.trace_flags = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.unique_fqdn_network = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.use_chap_auth = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.volume_backend_name = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.volume_clear = zero {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.volume_clear_ionice = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.volume_clear_size = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_reports.file_event_handler = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_reports.log_dir = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.backend_host = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.chap_password = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.chap_username = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.disk_geometry = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.driver_client_cert = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.extra_capabilities = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.filter_function = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.goodness_function = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.iser_helper = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.iser_ip_address = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.iser_port = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.lvm_share_target = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.lvm_type = auto {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.num_shell_tries = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.replication_device = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.report_discard_supported = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.reserved_percentage = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.scst_target_driver = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.storage_protocol = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.target_helper = lioadm {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.target_ip_address = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.target_port = 3260 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.trace_flags = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.use_chap_auth = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.volume_clear = zero {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.volume_clear_size = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] lvmdriver-1.volumes_dir = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.ssl = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_notifications.driver = [] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_notifications.retry = -1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] key_manager.fixed_key = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.barbican_api_version = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.barbican_endpoint = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.barbican_endpoint_type = public {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.barbican_region_name = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.cafile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.certfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.collect_timing = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.insecure = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.keyfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.number_of_retries = 60 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.retry_delay = 1 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.send_service_user_token = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.split_loggers = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.timeout = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.verify_ssl = True {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican.verify_ssl_path = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican_service_user.auth_section = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican_service_user.auth_type = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican_service_user.cafile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican_service_user.certfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican_service_user.collect_timing = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican_service_user.insecure = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican_service_user.keyfile = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican_service_user.split_loggers = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] barbican_service_user.timeout = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.approle_role_id = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.approle_secret_id = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.auth_method = approle {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.auth_path = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.kv_mountpoint = secret {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.kv_path = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.kv_version = 2 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.namespace = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.root_token_id = **** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.ssl_ca_crt_file = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.timeout = 60.0 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.token_file = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.token_role = None {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.use_ssl = False {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:04:54 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] ******************************************************************************** {{(pid=75076) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 20:04:55 devstack sudo[75362]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:55 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:55 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:55 devstack sudo[75428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:04:55 devstack sudo[75428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:55 devstack sudo[75428]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:55 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.262s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:55 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:04:55 devstack cinder-volume[75298]: INFO cinder.brick.local_dev.lvm [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 28 20:04:55 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:55 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:55 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:55 devstack sudo[75532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 20:04:55 devstack sudo[75532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:55 devstack sudo[75532]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:55 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:55 devstack cinder-volume[75298]: DEBUG cinder.brick.local_dev.lvm [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75298) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 28 20:04:55 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:55 devstack sudo[75621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:04:55 devstack sudo[75621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:57 devstack sudo[75621]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:57 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.629s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:57 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:57 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:57 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:57 devstack sudo[75948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:04:57 devstack sudo[75948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:57 devstack sudo[75948]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:57 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:57 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:57 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:57 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:57 devstack sudo[75999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 28 20:04:57 devstack sudo[75999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:57 devstack sudo[75999]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:57 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.269s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:57 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:57 devstack sudo[76008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 20:04:57 devstack sudo[76008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:58 devstack sudo[76008]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:58 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.234s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:58 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:58 devstack sudo[76011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 20:04:58 devstack sudo[76011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:58 devstack sudo[76011]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:58 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:58 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:58 devstack sudo[76014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:04:58 devstack sudo[76014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:58 devstack sudo[76014]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:58 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.233s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:58 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:58 devstack sudo[76017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:04:58 devstack sudo[76017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:58 devstack sudo[76017]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:58 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.233s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:58 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:58 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:58 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:58 devstack sudo[76021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:04:58 devstack sudo[76021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:59 devstack sudo[76021]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:59 devstack cinder-volume[75298]: INFO cinder.volume.drivers.lvm [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:59 devstack sudo[76025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:04:59 devstack sudo[76025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:59 devstack sudo[76025]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG cinder.volume.drivers.lvm [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Updating volume stats {{(pid=75298) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:59 devstack sudo[76029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 20:04:59 devstack sudo[76029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:59 devstack sudo[76029]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:59 devstack sudo[76034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:04:59 devstack sudo[76034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:04:59 devstack sudo[76034]: pam_unix(sudo:session): session closed for user root Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:04:59 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:04:59 devstack sudo[76037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:04:59 devstack sudo[76037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:05:00 devstack sudo[76037]: pam_unix(sudo:session): session closed for user root Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:05:00 devstack sudo[76040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:05:00 devstack sudo[76040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:05:00 devstack sudo[76040]: pam_unix(sudo:session): session closed for user root Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:05:00 devstack cinder-volume[75298]: INFO cinder.volume.driver [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Driver hasn't implemented _init_vendor_properties() Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG cinder.volume.driver [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75298) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG oslo_db.sqlalchemy.engines [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG dbcounter [-] [75298] Writer thread running {{(pid=75298) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG cinder.db.api [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Building query based on filter {{(pid=75298) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG cinder.image.image_utils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75298) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 20:05:00 devstack cinder-volume[75298]: INFO cinder.keymgr.migration [None req-c6e4b202-a337-4c3b-b1bb-988cb427acb4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG cinder.volume.drivers.lvm [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Updating volume stats {{(pid=75298) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:05:00 devstack sudo[76043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 20:05:00 devstack sudo[76043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:05:00 devstack sudo[76043]: pam_unix(sudo:session): session closed for user root Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:05:00 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:05:00 devstack sudo[76048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:05:00 devstack sudo[76048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:05:01 devstack sudo[76048]: pam_unix(sudo:session): session closed for user root Aug 28 20:05:01 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:05:01 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:05:01 devstack sudo[76054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:05:01 devstack sudo[76054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:05:01 devstack sudo[76054]: pam_unix(sudo:session): session closed for user root Aug 28 20:05:01 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:05:01 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:05:01 devstack sudo[76057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:05:01 devstack sudo[76057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:05:01 devstack sudo[76057]: pam_unix(sudo:session): session closed for user root Aug 28 20:05:01 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:05:01 devstack cinder-volume[75298]: DEBUG cinder.manager [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Notifying Schedulers of capabilities ... {{(pid=75298) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:05:01 devstack cinder-volume[75298]: INFO cinder.volume.manager [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Driver initialization completed successfully. Aug 28 20:05:01 devstack cinder-volume[75298]: INFO cinder.manager [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Initiating service 2 cleanup Aug 28 20:05:01 devstack cinder-volume[75298]: INFO cinder.manager [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Service 2 cleanup completed. Aug 28 20:05:01 devstack cinder-volume[75298]: DEBUG cinder.service [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Creating RPC server for service cinder-volume {{(pid=75298) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 20:05:01 devstack cinder-volume[75298]: DEBUG cinder.service [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75298) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 20:05:01 devstack cinder-volume[75298]: INFO cinder.volume.manager [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 28 20:05:01 devstack cinder-volume[75298]: DEBUG cinder.volume.drivers.lvm [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Updating volume stats {{(pid=75298) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 20:05:01 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:05:01 devstack sudo[76064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 20:05:01 devstack sudo[76064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:05:02 devstack sudo[76064]: pam_unix(sudo:session): session closed for user root Aug 28 20:05:02 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:05:02 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:05:02 devstack sudo[76067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:05:02 devstack sudo[76067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:05:02 devstack sudo[76067]: pam_unix(sudo:session): session closed for user root Aug 28 20:05:02 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:05:02 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:05:02 devstack sudo[76070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:05:02 devstack sudo[76070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:05:02 devstack sudo[76070]: pam_unix(sudo:session): session closed for user root Aug 28 20:05:02 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:05:02 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:05:02 devstack sudo[76079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:05:02 devstack sudo[76079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:05:03 devstack sudo[76079]: pam_unix(sudo:session): session closed for user root Aug 28 20:05:03 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.346s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:05:03 devstack cinder-volume[75298]: INFO cinder.volume.manager [None req-9f9f4312-df51-42a3-9f09-228bec0ff352 None None] Driver post RPC initialization completed successfully. Aug 28 20:05:04 devstack cinder-volume[75076]: DEBUG dbcounter [-] [75076] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75076) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:05:13 devstack cinder-volume[75298]: DEBUG dbcounter [-] [75298] Writing DB stats cinder:SELECT=2 {{(pid=75298) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:05:13 devstack cinder-volume[75298]: DEBUG dbcounter [-] [75298] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75298) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:05:51 devstack cinder-volume[75298]: DEBUG oslo_service.periodic_task [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running periodic task VolumeManager._thread_info {{(pid=75298) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:05:51 devstack cinder-volume[75298]: DEBUG cinder.volume.manager [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] thread count: 6 {{(pid=75298) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:05:51 devstack cinder-volume[75298]: DEBUG cinder.volume.manager [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] thread info: [<_MainThread(MainThread, started 139674198024320)>, , , , , ] {{(pid=75298) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:06:51 devstack cinder-volume[75298]: DEBUG oslo_service.periodic_task [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75298) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:06:51 devstack cinder-volume[75298]: DEBUG cinder.volume.drivers.lvm [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Updating volume stats {{(pid=75298) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 20:06:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:06:51 devstack sudo[81298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 20:06:51 devstack sudo[81298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:06:51 devstack sudo[81298]: pam_unix(sudo:session): session closed for user root Aug 28 20:06:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:06:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:06:51 devstack sudo[81301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:06:51 devstack sudo[81301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:06:51 devstack sudo[81301]: pam_unix(sudo:session): session closed for user root Aug 28 20:06:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:06:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:06:51 devstack sudo[81304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:06:51 devstack sudo[81304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:06:51 devstack sudo[81304]: pam_unix(sudo:session): session closed for user root Aug 28 20:06:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:06:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:06:51 devstack sudo[81307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:06:51 devstack sudo[81307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:06:52 devstack sudo[81307]: pam_unix(sudo:session): session closed for user root Aug 28 20:06:52 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:06:52 devstack cinder-volume[75298]: DEBUG cinder.manager [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Notifying Schedulers of capabilities ... {{(pid=75298) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:06:52 devstack cinder-volume[75298]: DEBUG oslo_service.periodic_task [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running periodic task VolumeManager._thread_info {{(pid=75298) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:06:52 devstack cinder-volume[75298]: DEBUG cinder.volume.manager [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] thread count: 6 {{(pid=75298) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:06:52 devstack cinder-volume[75298]: DEBUG cinder.volume.manager [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] thread info: [<_MainThread(MainThread, started 139674198024320)>, , , , , ] {{(pid=75298) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:07:13 devstack cinder-volume[75298]: DEBUG dbcounter [-] [75298] Writing DB stats cinder:SELECT=1 {{(pid=75298) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:07:13 devstack cinder-volume[75298]: DEBUG dbcounter [-] [75298] Writing DB stats cinder:UPDATE=1 {{(pid=75298) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:07:51 devstack cinder-volume[75298]: DEBUG oslo_service.periodic_task [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75298) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:07:51 devstack cinder-volume[75298]: DEBUG cinder.volume.drivers.lvm [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Updating volume stats {{(pid=75298) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 20:07:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:07:51 devstack sudo[83187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 20:07:51 devstack sudo[83187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:07:51 devstack sudo[83187]: pam_unix(sudo:session): session closed for user root Aug 28 20:07:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:07:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:07:51 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:07:51 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:07:51 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Aug 28 20:07:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:07:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:07:51 devstack sudo[83218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:07:51 devstack sudo[83218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:07:51 devstack sudo[83218]: pam_unix(sudo:session): session closed for user root Aug 28 20:07:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:07:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:07:51 devstack sudo[83221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:07:51 devstack sudo[83221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:07:52 devstack sudo[83221]: pam_unix(sudo:session): session closed for user root Aug 28 20:07:52 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:07:52 devstack cinder-volume[75298]: DEBUG cinder.manager [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Notifying Schedulers of capabilities ... {{(pid=75298) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:07:52 devstack cinder-volume[75298]: DEBUG oslo_service.periodic_task [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running periodic task VolumeManager._thread_info {{(pid=75298) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:07:52 devstack cinder-volume[75298]: DEBUG cinder.volume.manager [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] thread count: 6 {{(pid=75298) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:07:52 devstack cinder-volume[75298]: DEBUG cinder.volume.manager [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] thread info: [<_MainThread(MainThread, started 139674198024320)>, , , , , ] {{(pid=75298) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:08:51 devstack cinder-volume[75298]: DEBUG oslo_service.periodic_task [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75298) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:08:51 devstack cinder-volume[75298]: DEBUG cinder.volume.drivers.lvm [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Updating volume stats {{(pid=75298) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 28 20:08:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:08:51 devstack sudo[84535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 28 20:08:51 devstack sudo[84535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:08:51 devstack sudo[84535]: pam_unix(sudo:session): session closed for user root Aug 28 20:08:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:08:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:08:51 devstack sudo[84557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:08:51 devstack sudo[84557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:08:51 devstack sudo[84557]: pam_unix(sudo:session): session closed for user root Aug 28 20:08:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:08:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:08:51 devstack sudo[84560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 28 20:08:51 devstack sudo[84560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:08:51 devstack sudo[84560]: pam_unix(sudo:session): session closed for user root Aug 28 20:08:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:08:51 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:08:51 devstack sudo[84566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 28 20:08:51 devstack sudo[84566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:08:52 devstack sudo[84566]: pam_unix(sudo:session): session closed for user root Aug 28 20:08:52 devstack cinder-volume[75298]: DEBUG oslo_concurrency.processutils [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75298) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:08:52 devstack cinder-volume[75298]: DEBUG cinder.manager [None req-8e1e6eef-5db0-4470-8ed3-44c9db358f03 None None] Notifying Schedulers of capabilities ... {{(pid=75298) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:09:13 devstack cinder-volume[75298]: DEBUG dbcounter [-] [75298] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75298) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:09:16 devstack cinder-volume[75076]: INFO oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Caught SIGTERM, stopping children Aug 28 20:09:16 devstack cinder-volume[75076]: DEBUG oslo_concurrency.lockutils [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Acquiring lock "singleton_lock" {{(pid=75076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 20:09:16 devstack cinder-volume[75076]: DEBUG oslo_concurrency.lockutils [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Acquired lock "singleton_lock" {{(pid=75076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 20:09:16 devstack cinder-volume[75076]: DEBUG oslo_concurrency.lockutils [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Releasing lock "singleton_lock" {{(pid=75076) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 20:09:16 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Stop services. {{(pid=75076) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 28 20:09:16 devstack cinder-volume[75076]: DEBUG oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Killing children. {{(pid=75076) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 28 20:09:16 devstack cinder-volume[75076]: INFO oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Waiting on 1 children to exit Aug 28 20:09:16 devstack cinder-volume[75298]: DEBUG oslo_concurrency.lockutils [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Acquiring lock "singleton_lock" {{(pid=75298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 20:09:16 devstack cinder-volume[75298]: DEBUG oslo_concurrency.lockutils [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Acquired lock "singleton_lock" {{(pid=75298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 20:09:16 devstack cinder-volume[75298]: DEBUG oslo_concurrency.lockutils [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Releasing lock "singleton_lock" {{(pid=75298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 20:09:16 devstack cinder-volume[75298]: WARNING amqp [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 20:09:16 devstack cinder-volume[75298]: WARNING amqp [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 20:09:16 devstack cinder-volume[75076]: INFO oslo_service.backend._eventlet.service [None req-b0d2ce02-2244-4348-9678-aaa578822a25 None None] Child 75298 exited with status 0 Aug 28 20:09:17 devstack cinder-volume[85204]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 20:09:17 devstack cinder-volume[85204]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 20:09:17 devstack cinder-volume[85204]: we strongly recommend against using it for new projects. Aug 28 20:09:17 devstack cinder-volume[85204]: If you are already using Eventlet, we recommend migrating to a different Aug 28 20:09:17 devstack cinder-volume[85204]: framework. For more detail see Aug 28 20:09:17 devstack cinder-volume[85204]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 20:09:17 devstack cinder-volume[85204]: import eventlet # noqa Aug 28 20:09:19 devstack cinder-volume[85204]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 20:09:19 devstack cinder-volume[85204]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 20:09:19 devstack cinder-volume[85204]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 20:09:19 devstack cinder-volume[85204]: INFO dbcounter [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Registered counter for database cinder Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_db.sqlalchemy.engines [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG dbcounter [-] [85204] Writer thread running {{(pid=85204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 20:09:20 devstack cinder-volume[85204]: INFO cinder.rpc [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 20:09:20 devstack cinder-volume[85204]: INFO cinder.rpc [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_db.sqlalchemy.engines [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:09:20 devstack cinder-volume[85204]: INFO cinder.volume.manager [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Determined volume DB was empty at startup. Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG cinder.volume.manager [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85204) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 20:09:20 devstack cinder-volume[85204]: INFO cinder.volume.manager [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 28 20:09:20 devstack cinder-volume[85204]: WARNING stevedore.named [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 20:09:20 devstack cinder-volume[85204]: WARNING castellan.key_manager [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 20:09:20 devstack cinder-volume[85204]: WARNING cinder.keymgr.conf_key_mgr [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 20:09:20 devstack cinder-volume[85204]: INFO cinder.volume.manager [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_db.sqlalchemy.engines [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:09:20 devstack cinder-volume[85204]: INFO oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Starting 1 workers Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Started child 85417 {{(pid=85204) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Full set of CONF: {{(pid=85204) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] ******************************************************************************** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Configuration options gathered from: {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] ================================================================================ {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] allow_availability_zone_fallback = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] allow_compression_on_image_upload = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85417]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] allowed_direct_url_schemes = [] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] api_rate_limit = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] auth_strategy = keystone {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_availability_zone = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_host = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_name = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_stats_polling_interval = 60 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backup_api_class = cinder.backup.api.API {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backup_name_template = backup-%s {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backup_use_same_host = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backup_use_temp_snapshot = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] chap_password = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] chap_username = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cinder_internal_tenant_project_id = c8ce0989960d4141a3704ebc6e7e90f9 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cinder_internal_tenant_user_id = b7aea6b640764d1a89b21331770df6cc {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cluster = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] compression_format = gzip {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] compute_api_class = cinder.compute.nova.API {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] config_dir = [] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] config_source = [] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] control_exchange = openstack {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] debug = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] default_availability_zone = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] default_group_type = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] default_volume_type = QuobyteHD {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] disk_geometry = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] driver_client_cert = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] driver_client_cert_key = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] driver_data_namespace = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] driver_ssl_cert_path = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] driver_ssl_cert_verify = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] driver_use_ssl = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] enable_new_services = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] enable_unsupported_driver = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] enabled_backends = ['QuobyteHD'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] enforce_multipath_for_image_xfer = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] filter_function = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance_api_insecure = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance_api_servers = ['http://192.168.122.98/image'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance_api_ssl_compression = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance_ca_certificates_file = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance_catalog_info = image:glance:publicURL {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance_certfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance_keyfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance_num_retries = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance_request_timeout = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] goodness_function = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] graceful_shutdown_timeout = 5 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] group_api_class = cinder.group.api.API {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] host = devstack {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] image_compress_on_upload = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] image_conversion_address_space_limit = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] image_conversion_cpu_limit = 60 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] image_conversion_disable = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] image_upload_use_cinder_backend = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] image_upload_use_internal_tenant = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] image_volume_cache_enabled = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] image_volume_cache_max_count = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] image_volume_cache_max_size_gb = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] init_host_max_objects_retrieval = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] instance_format = [instance: %(uuid)s] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] iscsi_target_flags = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] iscsi_write_cache = on {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] iser_helper = tgtadm {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] iser_ip_address = 192.168.122.98 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] iser_port = 3260 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] log_color = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] log_config_append = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] log_dir = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] log_file = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] log_options = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] log_rotate_interval = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85417]: INFO cinder.volume.manager [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 28 20:09:20 devstack cinder-volume[85417]: DEBUG cinder.volume.drivers.remotefs [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85417) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] log_rotate_interval_type = days {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] log_rotation_type = none {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] max_age = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] max_logfile_count = 30 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] max_logfile_size_mb = 200 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] max_over_subscription_ratio = 20.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] message_reap_interval = 86400 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] message_ttl = 2592000 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] migration_create_volume_timeout_secs = 300 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] monkey_patch = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] monkey_patch_modules = [] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] my_ip = 192.168.122.98 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] no_snapshot_gb_quota = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] num_iser_scan_tries = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] num_shell_tries = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] num_volume_device_scan_tries = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] nvmeof_conn_info_version = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] nvmet_ns_id = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] nvmet_port_id = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] osapi_max_limit = 1000 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] osapi_volume_ext_list = [] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] osapi_volume_listen = 0.0.0.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] osapi_volume_listen_port = 8776 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] osapi_volume_use_ssl = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] osapi_volume_workers = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] per_volume_size_limit = -1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] periodic_fuzzy_delay = 60 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] periodic_interval = 60 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] project_id_regex = [0-9a-f\-]+ {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] public_endpoint = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] publish_errors = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] quota_backup_gigabytes = 1000 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] quota_backups = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] quota_gigabytes = 1000 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] quota_groups = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] quota_snapshots = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] quota_volumes = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] rate_limit_burst = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] rate_limit_except_level = CRITICAL {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] rate_limit_interval = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] reinit_driver_count = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] replication_device = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] report_discard_supported = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] report_interval = 120 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] reservation_clean_interval = 86400 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] reservation_expire = 86400 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] reserved_image_namespaces = [] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] reserved_percentage = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] rpc_response_timeout = 120 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] run_external_periodic_tasks = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] scst_target_driver = iscsi {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] scst_target_iqn_name = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_down_time = 720 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] shell_completion = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] snapshot_name_template = snapshot-%s {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] split_loggers = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] state_path = /opt/stack/data/cinder {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] storage_availability_zone = nova {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] storage_protocol = iSCSI {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] syslog_log_facility = LOG_USER {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] target_helper = lioadm {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] target_ip_address = 192.168.122.98 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] target_port = 3260 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] target_protocol = iscsi {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] target_secondary_ip_addresses = [] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] trace_flags = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] transfer_api_class = cinder.transfer.api.API {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] transport_url = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] until_refresh = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] use_chap_auth = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] use_default_quota_class = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] use_journal = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] use_json = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] use_multipath_for_image_xfer = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] use_stderr = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] use_syslog = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] verify_glance_signatures = enabled {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_api_class = cinder.volume.api.API {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_backend_name = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_clear = zero {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_clear_ionice = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_clear_size = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_copy_bps_limit = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_dd_blocksize = 1M {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_name_template = volume-%s {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_service_inithost_offload = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volume_usage_audit_period = month {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] zoning_mode = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_concurrency.disable_process_locking = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.auth_section = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.auth_type = password {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.auth_version = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.cache = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.certfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.delay_auth_decision = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.http_connect_timeout = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.include_service_catalog = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.insecure = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.interface = public {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.keyfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_password = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcache_username = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.region_name = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.service_token_roles_required = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.service_type = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.token_cache_time = 300 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.backend = dogpile.cache.null {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85417]: DEBUG cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85417) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.backend_argument = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.backend_expiration_time = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.config_prefix = cache.oslo {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.debug_cache_backend = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.enable_retry_client = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.enable_socket_keepalive = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85417]: WARNING cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 28 20:09:20 devstack cinder-volume[85417]: WARNING cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 28 20:09:20 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Running cmd (subprocess): mount.quobyte {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.enabled = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.expiration_time = 600 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.hashclient_retry_attempts = 2 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.memcache_dead_retry = 300 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.memcache_pool_maxsize = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.memcache_sasl_enabled = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.password = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.proxies = [] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.redis_db = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.redis_sentinel_service_name = mymaster {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.redis_server = localhost:6379 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.retry_attempts = 2 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.retry_delay = 0.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.socket_keepalive_count = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.socket_keepalive_idle = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.socket_keepalive_interval = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.socket_timeout = 1.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.tls_allowed_ciphers = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.tls_cafile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.tls_certfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.tls_enabled = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.tls_keyfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cache.username = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] coordination.backend_url = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.asyncio_connection = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.asyncio_slave_connection = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.backend = sqlalchemy {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.connection = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.connection_debug = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.connection_parameters = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.connection_recycle_time = 3600 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.connection_trace = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.db_inc_retry_interval = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.db_max_retries = 20 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.db_max_retry_interval = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.db_retry_interval = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.max_overflow = 50 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.max_pool_size = 5 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.max_retries = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.mysql_wsrep_sync_wait = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.pool_timeout = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.retry_interval = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.slave_connection = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.sqlite_synchronous = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.synchronous_reader = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] database.use_db_reconnect = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_tracing.insecure = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.connection_string = messaging:// {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.enabled = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.es_doc_type = notification {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.es_scroll_size = 10000 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.es_scroll_time = 2m {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.filter_error_trace = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.hmac_keys = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.sentinel_service_name = mymaster {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.socket_timeout = 0.1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.trace_requests = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler.trace_sqlalchemy = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler_jaeger.process_tags = {} {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler_jaeger.service_name_prefix = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] profiler_otlp.service_name_prefix = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_policy.enforce_new_defaults = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_policy.policy_default_rule = default {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_policy.policy_file = policy.yaml {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_policy.remote_timeout = 60.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] privsep_osbrick.group = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] privsep_osbrick.helper_command = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] privsep_osbrick.user = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cinder_sys_admin.group = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cinder_sys_admin.helper_command = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] cinder_sys_admin.user = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_user.auth_section = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_user.auth_type = password {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_user.cafile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_user.certfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_user.collect_timing = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_user.insecure = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_user.keyfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_user.send_service_user_token = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_user.split_loggers = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] service_user.timeout = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance.auth_section = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance.auth_type = password {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance.certfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance.collect_timing = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance.insecure = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance.keyfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance.region_name = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance.split_loggers = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] glance.timeout = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.backend_availability_zone = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.chap_password = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.chap_username = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.disk_geometry = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.driver_client_cert = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.driver_client_cert_key = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.driver_data_namespace = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.driver_use_ssl = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.enable_unsupported_driver = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.extra_capabilities = {} {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.filter_function = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.goodness_function = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.iscsi_target_flags = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.iscsi_write_cache = on {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.iser_helper = tgtadm {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.iser_port = 3260 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nas_host = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nas_login = admin {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nas_mount_options = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nas_password = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nas_private_key = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nas_share_path = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nas_ssh_port = 22 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.num_shell_tries = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.nvmet_port_id = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.quobyte_client_cfg = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.quobyte_volume_url = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.replication_device = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.report_discard_supported = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.reserved_percentage = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.scst_target_driver = iscsi {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.scst_target_iqn_name = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.storage_protocol = iSCSI {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.target_helper = tgtadm {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.target_port = 3260 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.target_protocol = iscsi {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.trace_flags = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.unique_fqdn_network = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.use_chap_auth = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.volume_backend_name = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.volume_clear = zero {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.volume_clear_ionice = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.volume_clear_size = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_reports.file_event_handler = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_reports.log_dir = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.backend_availability_zone = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.backend_host = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.chap_password = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.chap_username = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.chiscsi_conf = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.disk_geometry = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.driver_client_cert = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.driver_client_cert_key = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.driver_data_namespace = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.driver_use_ssl = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.extra_capabilities = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.filter_function = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.goodness_function = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.iscsi_target_flags = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.iscsi_write_cache = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.iser_helper = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.iser_ip_address = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.iser_port = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.iser_target_prefix = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nas_host = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nas_login = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nas_mount_options = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nas_password = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nas_private_key = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nas_share_path = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nas_ssh_port = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.num_shell_tries = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nvmet_ns_id = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.nvmet_port_id = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.replication_device = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.report_discard_supported = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.reserved_percentage = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.scst_target_driver = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.storage_protocol = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.target_helper = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.target_ip_address = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.target_port = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.target_prefix = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.target_protocol = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.trace_flags = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.unique_fqdn_network = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.use_chap_auth = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.volume_clear = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.volume_clear_ionice = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.volume_clear_size = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] QuobyteHD.volumes_dir = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack quobyte-client[85418]: Reading configuration file: /etc/quobyte/client.cfg Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack quobyte-client[85418]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.ssl = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.ssl_version = {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_notifications.driver = [] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_notifications.retry = -1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] oslo_messaging_notifications.transport_url = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] key_manager.fixed_key = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.barbican_api_version = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.barbican_endpoint = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.barbican_endpoint_type = public {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.barbican_region_name = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.cafile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.certfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.collect_timing = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.insecure = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.keyfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.number_of_retries = 60 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.retry_delay = 1 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.send_service_user_token = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.split_loggers = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.timeout = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.verify_ssl = True {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican.verify_ssl_path = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican_service_user.auth_section = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican_service_user.auth_type = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican_service_user.cafile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican_service_user.certfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican_service_user.collect_timing = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican_service_user.insecure = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican_service_user.keyfile = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican_service_user.split_loggers = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] barbican_service_user.timeout = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.approle_role_id = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.approle_secret_id = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.auth_method = approle {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.auth_path = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.kv_mountpoint = secret {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.kv_path = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.kv_version = 2 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.namespace = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.root_token_id = **** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.ssl_ca_crt_file = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.timeout = 60.0 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.token_file = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.token_role = None {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.use_ssl = False {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:20 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] ******************************************************************************** {{(pid=85204) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 20:09:20 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] CMD "mount.quobyte" returned: 1 in 0.159s {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:09:20 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:09:20 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:09:20 devstack cinder-volume[85417]: DEBUG cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=85417) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:09:20 devstack cinder-volume[85417]: INFO cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 ... Aug 28 20:09:20 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 -c /etc/quobyte/client-cinder.cfg {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:09:21 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 -c /etc/quobyte/client-cinder.cfg Aug 28 20:09:21 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:09:21 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.369s {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:09:21 devstack cinder-volume[85417]: INFO cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 succeeded Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=85417) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.379s {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:09:21 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:09:21 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:09:21 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.236s {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:09:21 devstack cinder-volume[85417]: INFO cinder.volume.driver [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Driver hasn't implemented _init_vendor_properties() Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG cinder.volume.driver [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.56498336792, 'free_capacity_gb': 1774.56498336792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85417) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG oslo_db.sqlalchemy.engines [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG dbcounter [-] [85417] Writer thread running {{(pid=85417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG cinder.db.api [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Building query based on filter {{(pid=85417) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG cinder.image.image_utils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85417) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 20:09:21 devstack cinder-volume[85417]: INFO cinder.keymgr.migration [None req-0ecfb239-b503-4848-9a96-81574aa476c5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=85417) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=85417) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:09:21 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:09:21 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:09:21 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.238s {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:09:21 devstack cinder-volume[85417]: DEBUG cinder.manager [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Notifying Schedulers of capabilities ... {{(pid=85417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:09:22 devstack cinder-volume[85417]: INFO cinder.volume.manager [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Driver initialization completed successfully. Aug 28 20:09:22 devstack cinder-volume[85417]: INFO cinder.manager [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Initiating service 3 cleanup Aug 28 20:09:22 devstack cinder-volume[85417]: INFO cinder.manager [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Service 3 cleanup completed. Aug 28 20:09:22 devstack cinder-volume[85417]: DEBUG cinder.service [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Creating RPC server for service cinder-volume {{(pid=85417) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 20:09:22 devstack cinder-volume[85417]: DEBUG cinder.service [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85417) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 20:09:22 devstack cinder-volume[85417]: INFO cinder.volume.manager [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 28 20:09:22 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:09:22 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:09:22 devstack cinder-volume[85417]: DEBUG cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=85417) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:09:22 devstack cinder-volume[85417]: DEBUG cinder.volume.drivers.quobyte [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=85417) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:09:22 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:09:22 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:09:22 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:09:22 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:09:22 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Aug 28 20:09:22 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.261s {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:09:22 devstack cinder-volume[85417]: INFO cinder.volume.manager [None req-2ad52e89-63f7-4524-8746-d87ddc118a48 None None] Driver post RPC initialization completed successfully. Aug 28 20:09:26 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-d774e7b0-5f5b-4c14-a04e-f8966bb67f77 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:09:26 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-d774e7b0-5f5b-4c14-a04e-f8966bb67f77 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:09:26 devstack cinder-volume[85417]: DEBUG cinder.volume.drivers.quobyte [None req-d774e7b0-5f5b-4c14-a04e-f8966bb67f77 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=85417) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:09:26 devstack cinder-volume[85417]: DEBUG cinder.volume.drivers.quobyte [None req-d774e7b0-5f5b-4c14-a04e-f8966bb67f77 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=85417) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:09:26 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-d774e7b0-5f5b-4c14-a04e-f8966bb67f77 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85417) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:09:26 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-d774e7b0-5f5b-4c14-a04e-f8966bb67f77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:09:26 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:09:26 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:09:27 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Aug 28 20:09:27 devstack cinder-volume[85417]: DEBUG oslo_concurrency.processutils [None req-d774e7b0-5f5b-4c14-a04e-f8966bb67f77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.229s {{(pid=85417) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:09:27 devstack cinder-volume[85417]: DEBUG cinder.manager [None req-d774e7b0-5f5b-4c14-a04e-f8966bb67f77 None None] Notifying Schedulers of capabilities ... {{(pid=85417) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:09:30 devstack cinder-volume[85204]: INFO oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Caught SIGTERM, stopping children Aug 28 20:09:30 devstack cinder-volume[85204]: DEBUG oslo_concurrency.lockutils [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Acquiring lock "singleton_lock" {{(pid=85204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 20:09:30 devstack cinder-volume[85204]: DEBUG oslo_concurrency.lockutils [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Acquired lock "singleton_lock" {{(pid=85204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 20:09:30 devstack cinder-volume[85204]: DEBUG oslo_concurrency.lockutils [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Releasing lock "singleton_lock" {{(pid=85204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 20:09:30 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Stop services. {{(pid=85204) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 28 20:09:30 devstack cinder-volume[85204]: DEBUG oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Killing children. {{(pid=85204) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 28 20:09:30 devstack cinder-volume[85204]: INFO oslo_service.backend._eventlet.service [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Waiting on 1 children to exit Aug 28 20:09:32 devstack cinder-volume[85417]: DEBUG dbcounter [-] [85417] Writing DB stats cinder:SELECT=2 {{(pid=85417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:09:32 devstack cinder-volume[85417]: DEBUG dbcounter [-] [85417] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:09:35 devstack cinder-volume[85417]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 28 20:09:35 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Acquiring lock "singleton_lock" {{(pid=85417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 20:09:35 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Acquired lock "singleton_lock" {{(pid=85417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 20:09:35 devstack cinder-volume[85417]: DEBUG oslo_concurrency.lockutils [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Releasing lock "singleton_lock" {{(pid=85417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 20:09:35 devstack cinder-volume[85417]: WARNING amqp [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 20:09:35 devstack cinder-volume[85417]: WARNING amqp [None req-9ece0166-2d41-4f14-ae30-75dee674b2fa None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 28 20:09:35 devstack cinder-volume[85721]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 28 20:09:35 devstack cinder-volume[85721]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 20:09:35 devstack cinder-volume[85721]: we strongly recommend against using it for new projects. Aug 28 20:09:35 devstack cinder-volume[85721]: If you are already using Eventlet, we recommend migrating to a different Aug 28 20:09:35 devstack cinder-volume[85721]: framework. For more detail see Aug 28 20:09:35 devstack cinder-volume[85721]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 20:09:35 devstack cinder-volume[85721]: import eventlet # noqa Aug 28 20:09:38 devstack cinder-volume[85721]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 28 20:09:38 devstack cinder-volume[85721]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 28 20:09:38 devstack cinder-volume[85721]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85721) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 28 20:09:38 devstack cinder-volume[85721]: INFO dbcounter [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Registered counter for database cinder Aug 28 20:09:38 devstack cinder-volume[85721]: DEBUG oslo_db.sqlalchemy.engines [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85721) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG dbcounter [-] [85721] Writer thread running {{(pid=85721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 20:09:39 devstack cinder-volume[85721]: INFO cinder.rpc [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 28 20:09:39 devstack cinder-volume[85721]: INFO cinder.rpc [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_db.sqlalchemy.engines [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85721) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:09:39 devstack cinder-volume[85721]: INFO cinder.volume.manager [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Determined volume DB was empty at startup. Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG cinder.volume.manager [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85721) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 28 20:09:39 devstack cinder-volume[85721]: WARNING stevedore.named [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 28 20:09:39 devstack cinder-volume[85721]: WARNING castellan.key_manager [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 20:09:39 devstack cinder-volume[85721]: WARNING cinder.keymgr.conf_key_mgr [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 28 20:09:39 devstack cinder-volume[85721]: INFO cinder.volume.manager [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_db.sqlalchemy.engines [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85721) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:09:39 devstack cinder-volume[85721]: INFO oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Starting 1 workers Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Started child 86028 {{(pid=85721) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Full set of CONF: {{(pid=85721) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] ******************************************************************************** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] Configuration options gathered from: {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] ================================================================================ {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 28 20:09:39 devstack cinder-volume[86028]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] allow_availability_zone_fallback = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] allow_compression_on_image_upload = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] allowed_direct_url_schemes = [] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] api_rate_limit = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] auth_strategy = keystone {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_availability_zone = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_host = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_name = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_stats_polling_interval = 60 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backup_api_class = cinder.backup.api.API {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backup_name_template = backup-%s {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backup_use_same_host = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backup_use_temp_snapshot = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] chap_password = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] chap_username = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cinder_internal_tenant_project_id = c8ce0989960d4141a3704ebc6e7e90f9 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cinder_internal_tenant_user_id = b7aea6b640764d1a89b21331770df6cc {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cluster = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] compression_format = gzip {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] compute_api_class = cinder.compute.nova.API {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] config_dir = [] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] config_source = [] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] control_exchange = openstack {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] debug = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] default_availability_zone = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] default_group_type = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] default_volume_type = QuobyteHD {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] disk_geometry = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] driver_client_cert = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] driver_client_cert_key = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] driver_data_namespace = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] driver_ssl_cert_path = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] driver_ssl_cert_verify = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] driver_use_ssl = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] enable_new_services = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] enable_unsupported_driver = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] enabled_backends = ['QuobyteHD'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] enforce_multipath_for_image_xfer = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] filter_function = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance_api_insecure = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance_api_servers = ['http://192.168.122.98/image'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance_api_ssl_compression = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance_ca_certificates_file = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance_catalog_info = image:glance:publicURL {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance_certfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance_keyfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance_num_retries = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance_request_timeout = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] goodness_function = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] graceful_shutdown_timeout = 5 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] group_api_class = cinder.group.api.API {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] host = devstack {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] image_compress_on_upload = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] image_conversion_address_space_limit = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] image_conversion_cpu_limit = 60 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] image_conversion_disable = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] image_upload_use_cinder_backend = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] image_upload_use_internal_tenant = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] image_volume_cache_enabled = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] image_volume_cache_max_count = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] image_volume_cache_max_size_gb = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] init_host_max_objects_retrieval = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] instance_format = [instance: %(uuid)s] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] iscsi_target_flags = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] iscsi_write_cache = on {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] iser_helper = tgtadm {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] iser_ip_address = 192.168.122.98 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] iser_port = 3260 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] log_color = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] log_config_append = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] log_dir = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] log_file = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] log_options = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] log_rotate_interval = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Starting volume driver QuobyteDriver (1.2.1) Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] log_rotate_interval_type = days {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86028) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] log_rotation_type = none {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] max_age = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] max_logfile_count = 30 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] max_logfile_size_mb = 200 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] max_over_subscription_ratio = 20.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] message_reap_interval = 86400 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] message_ttl = 2592000 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] migration_create_volume_timeout_secs = 300 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] monkey_patch = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] monkey_patch_modules = [] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] my_ip = 192.168.122.98 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] no_snapshot_gb_quota = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] num_iser_scan_tries = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] num_shell_tries = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] num_volume_device_scan_tries = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] nvmeof_conn_info_version = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] nvmet_ns_id = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] nvmet_port_id = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] osapi_max_limit = 1000 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] osapi_volume_ext_list = [] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] osapi_volume_listen_port = 8776 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] osapi_volume_use_ssl = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] osapi_volume_workers = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] per_volume_size_limit = -1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] periodic_fuzzy_delay = 60 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] periodic_interval = 60 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] public_endpoint = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] publish_errors = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] quota_backup_gigabytes = 1000 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] quota_backups = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] quota_gigabytes = 1000 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] quota_groups = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] quota_snapshots = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] quota_volumes = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] rate_limit_burst = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] rate_limit_except_level = CRITICAL {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] rate_limit_interval = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] reinit_driver_count = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] replication_device = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] report_discard_supported = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] report_interval = 120 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] reservation_clean_interval = 86400 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] reservation_expire = 86400 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] reserved_image_namespaces = [] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] reserved_percentage = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] rpc_response_timeout = 120 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] run_external_periodic_tasks = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] scst_target_driver = iscsi {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] scst_target_iqn_name = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_down_time = 720 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] shell_completion = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] snapshot_name_template = snapshot-%s {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] split_loggers = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] state_path = /opt/stack/data/cinder {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] storage_availability_zone = nova {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] storage_protocol = iSCSI {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] syslog_log_facility = LOG_USER {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] target_helper = lioadm {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] target_ip_address = 192.168.122.98 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] target_port = 3260 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] target_protocol = iscsi {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] target_secondary_ip_addresses = [] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] trace_flags = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] transport_url = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] until_refresh = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] use_chap_auth = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] use_default_quota_class = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] use_journal = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] use_json = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] use_multipath_for_image_xfer = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] use_stderr = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] use_syslog = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] verify_glance_signatures = enabled {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_api_class = cinder.volume.api.API {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_backend_name = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_clear = zero {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_clear_ionice = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_clear_size = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_copy_bps_limit = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_dd_blocksize = 1M {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_name_template = volume-%s {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_service_inithost_offload = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volume_usage_audit_period = month {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] zoning_mode = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_concurrency.disable_process_locking = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.auth_section = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.auth_type = password {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.auth_version = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.cache = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86028) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 28 20:09:39 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.quobyte [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 28 20:09:39 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.quobyte [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.certfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.include_service_catalog = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Running cmd (subprocess): mount.quobyte {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.insecure = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.interface = public {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.keyfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_password = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcache_username = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.region_name = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.service_type = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.backend = dogpile.cache.null {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.backend_argument = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.backend_expiration_time = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.config_prefix = cache.oslo {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.debug_cache_backend = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.enable_retry_client = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.enable_socket_keepalive = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.enabled = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.expiration_time = 600 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.hashclient_retry_attempts = 2 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.memcache_dead_retry = 300 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.memcache_pool_maxsize = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.memcache_sasl_enabled = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.password = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.proxies = [] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.redis_db = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.redis_server = localhost:6379 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.retry_attempts = 2 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.retry_delay = 0.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.socket_keepalive_count = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.socket_keepalive_idle = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.socket_keepalive_interval = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.socket_timeout = 1.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.tls_allowed_ciphers = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.tls_cafile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.tls_certfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.tls_enabled = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.tls_keyfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cache.username = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] coordination.backend_url = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.asyncio_connection = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.asyncio_slave_connection = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.backend = sqlalchemy {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.connection = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.connection_debug = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.connection_parameters = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.connection_recycle_time = 3600 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.connection_trace = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.db_inc_retry_interval = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.db_max_retries = 20 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.db_max_retry_interval = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.db_retry_interval = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.max_overflow = 50 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.max_pool_size = 5 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.max_retries = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.mysql_wsrep_sync_wait = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.pool_timeout = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.retry_interval = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.slave_connection = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.sqlite_synchronous = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.synchronous_reader = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] database.use_db_reconnect = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_tracing.insecure = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.connection_string = messaging:// {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.enabled = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.es_doc_type = notification {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.es_scroll_size = 10000 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.es_scroll_time = 2m {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.filter_error_trace = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.hmac_keys = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.sentinel_service_name = mymaster {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack quobyte-client[86032]: Reading configuration file: /etc/quobyte/client.cfg Aug 28 20:09:39 devstack quobyte-client[86032]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.socket_timeout = 0.1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.trace_requests = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler.trace_sqlalchemy = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler_jaeger.process_tags = {} {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler_jaeger.service_name_prefix = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] profiler_otlp.service_name_prefix = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_policy.enforce_new_defaults = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_policy.policy_default_rule = default {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_policy.policy_file = policy.yaml {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] privsep_osbrick.group = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] privsep_osbrick.helper_command = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] privsep_osbrick.user = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cinder_sys_admin.group = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cinder_sys_admin.helper_command = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] cinder_sys_admin.user = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_user.auth_section = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_user.auth_type = password {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_user.cafile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_user.certfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_user.collect_timing = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_user.insecure = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_user.keyfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_user.send_service_user_token = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_user.split_loggers = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] service_user.timeout = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance.auth_section = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance.auth_type = password {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance.certfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance.collect_timing = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance.insecure = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance.keyfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance.region_name = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance.split_loggers = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] glance.timeout = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.backend_availability_zone = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.chap_password = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.chap_username = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.disk_geometry = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.driver_client_cert = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.driver_client_cert_key = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.driver_data_namespace = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.driver_use_ssl = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.extra_capabilities = {} {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.filter_function = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.goodness_function = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.iscsi_target_flags = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.iscsi_write_cache = on {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.iser_helper = tgtadm {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.iser_port = 3260 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nas_host = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nas_login = admin {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nas_mount_options = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nas_password = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nas_private_key = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nas_share_path = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.num_shell_tries = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.quobyte_volume_url = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.replication_device = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.report_discard_supported = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.reserved_percentage = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.target_helper = tgtadm {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.target_port = 3260 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.target_protocol = iscsi {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.trace_flags = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.unique_fqdn_network = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.use_chap_auth = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.volume_backend_name = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.volume_clear = zero {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.volume_clear_ionice = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.volume_clear_size = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack sudo[86034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_reports.file_event_handler = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_reports.log_dir = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.backend_availability_zone = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.backend_host = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.chap_password = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.chap_username = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.chiscsi_conf = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.disk_geometry = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.driver_client_cert = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.driver_data_namespace = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.driver_use_ssl = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.extra_capabilities = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.filter_function = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.goodness_function = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.iser_helper = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.iser_ip_address = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.iser_port = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.iser_target_prefix = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nas_host = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nas_login = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nas_mount_options = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nas_password = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nas_private_key = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nas_share_path = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nas_ssh_port = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.num_shell_tries = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.nvmet_port_id = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.replication_device = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.report_discard_supported = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.reserved_percentage = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.scst_target_driver = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.storage_protocol = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.target_helper = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.target_ip_address = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.target_port = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.target_prefix = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.target_protocol = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.trace_flags = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.use_chap_auth = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.volume_clear = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.volume_clear_size = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] QuobyteHD.volumes_dir = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.ssl = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_notifications.driver = [] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_notifications.retry = -1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] key_manager.fixed_key = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.barbican_api_version = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.barbican_endpoint = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.barbican_endpoint_type = public {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.barbican_region_name = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.cafile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.certfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.collect_timing = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.insecure = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.keyfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.number_of_retries = 60 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.retry_delay = 1 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.send_service_user_token = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.split_loggers = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.timeout = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.verify_ssl = True {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican.verify_ssl_path = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican_service_user.auth_section = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican_service_user.auth_type = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican_service_user.cafile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican_service_user.certfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican_service_user.collect_timing = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican_service_user.insecure = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican_service_user.keyfile = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican_service_user.split_loggers = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] barbican_service_user.timeout = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.approle_role_id = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.approle_secret_id = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.auth_method = approle {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.auth_path = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.kv_mountpoint = secret {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.kv_path = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.kv_version = 2 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.namespace = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.root_token_id = **** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.ssl_ca_crt_file = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.timeout = 60.0 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.token_file = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.token_role = None {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.use_ssl = False {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 28 20:09:39 devstack cinder-volume[85721]: DEBUG oslo_service.backend._eventlet.service [None req-3ade7904-0612-4cf9-876c-e637eccc39c9 None None] ******************************************************************************** {{(pid=85721) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 28 20:09:39 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.258s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:09:39 devstack cinder-volume[86028]: INFO cinder.volume.driver [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Driver hasn't implemented _init_vendor_properties() Aug 28 20:09:39 devstack cinder-volume[86028]: DEBUG cinder.volume.driver [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.56498336792, 'free_capacity_gb': 1774.56498336792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86028) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_db.sqlalchemy.engines [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writer thread running {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG cinder.db.api [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Building query based on filter {{(pid=86028) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86028) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:09:40 devstack cinder-volume[86028]: INFO cinder.keymgr.migration [None req-7912c4e2-ccee-47a9-a8e6-ecf4d6e4570b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 28 20:09:40 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:09:40 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:09:40 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.226s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:09:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Driver initialization completed successfully. Aug 28 20:09:40 devstack cinder-volume[86028]: INFO cinder.manager [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Initiating service 3 cleanup Aug 28 20:09:40 devstack cinder-volume[86028]: INFO cinder.manager [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Service 3 cleanup completed. Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG cinder.service [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Creating RPC server for service cinder-volume {{(pid=86028) start /opt/stack/cinder/cinder/service.py:231}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG cinder.service [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86028) start /opt/stack/cinder/cinder/service.py:237}} Aug 28 20:09:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:09:40 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:09:40 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:09:40 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Aug 28 20:09:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:09:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6815b5e9-7fb3-4155-a1db-7095c0d1a25b None None] Driver post RPC initialization completed successfully. Aug 28 20:09:49 devstack cinder-volume[85721]: DEBUG dbcounter [-] [85721] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:09:50 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:09:50 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=3 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:10:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:10:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 6 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:10:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Flow 'volume_create_manager' (50598cb2-f8a0-498f-a291-f3e1b49ded0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897bbdcc-264c-4d9a-b533-f304967c5e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897bbdcc-264c-4d9a-b533-f304967c5e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-499069950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c477fb6-cf07-4487-90ea-f96ff9d45760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c0deb58634048aaad5ed02b9c288a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:10:38Z,use_quota=True,user_id='c72f54e47b824f9d81290d0868850a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10907689-efb4-4a2e-8bf0-2f0278b43643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10907689-efb4-4a2e-8bf0-2f0278b43643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc0faa2-7ab2-4372-a730-2119106219eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc0faa2-7ab2-4372-a730-2119106219eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c477fb6-cf07-4487-90ea-f96ff9d45760', 'volume_name': 'volume-3c477fb6-cf07-4487-90ea-f96ff9d45760', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f13bd9-eab3-47de-a184-e09386520f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f13bd9-eab3-47de-a184-e09386520f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3b8a22-d27a-4bce-9cf1-ebb0076260c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:38 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Volume 3c477fb6-cf07-4487-90ea-f96ff9d45760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c477fb6-cf07-4487-90ea-f96ff9d45760', 'volume_size': 1} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-499069950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c477fb6-cf07-4487-90ea-f96ff9d45760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c0deb58634048aaad5ed02b9c288a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:10:38Z,use_quota=True,user_id='c72f54e47b824f9d81290d0868850a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Creating volume 3c477fb6-cf07-4487-90ea-f96ff9d45760 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:10:38 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:10:38 devstack sudo[86412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760 1073741824 Aug 28 20:10:38 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:10:38 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760 1073741824" returned: 0 in 0.650s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:10:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:10:39 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760 Aug 28 20:10:39 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:10:39 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Aug 28 20:10:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760" returned: 0 in 0.286s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:10:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:10:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:10:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3b8a22-d27a-4bce-9cf1-ebb0076260c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c477fb6-cf07-4487-90ea-f96ff9d45760', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a949de0-f5cd-40de-b94d-df1d9b0cb07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:39 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Volume volume-3c477fb6-cf07-4487-90ea-f96ff9d45760 (3c477fb6-cf07-4487-90ea-f96ff9d45760): created successfully Aug 28 20:10:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a949de0-f5cd-40de-b94d-df1d9b0cb07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Flow 'volume_create_manager' (50598cb2-f8a0-498f-a291-f3e1b49ded0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:10:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4bca83ae-84cd-4ee0-aefb-c84da8c4b391 tempest-TaggedAttachmentsTest-1353595995 None] Created volume successfully. Aug 28 20:10:49 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:10:49 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Flow 'volume_create_manager' (1cbd8b30-411c-4b6b-9d92-930065e4fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1b06d4-5efe-4f2f-9ed8-23ccf7a496c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1b06d4-5efe-4f2f-9ed8-23ccf7a496c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-853688097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a74c43-01ed-442d-ba04-f371da627422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96faf903c474367a218ce90247471b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:10:51Z,use_quota=True,user_id='2c6d2300bab24ff5a31d9fb312386433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c95613-0b38-475e-bbf3-01e278172c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c95613-0b38-475e-bbf3-01e278172c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ba98ac-4957-40fd-abad-fedfe70a983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ba98ac-4957-40fd-abad-fedfe70a983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a74c43-01ed-442d-ba04-f371da627422', 'volume_name': 'volume-64a74c43-01ed-442d-ba04-f371da627422', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfb6baa-cdfd-4841-9126-1d7c59fdc3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfb6baa-cdfd-4841-9126-1d7c59fdc3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fef49b-94b7-46ad-8165-463292fa74f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:51 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Volume 64a74c43-01ed-442d-ba04-f371da627422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a74c43-01ed-442d-ba04-f371da627422', 'volume_size': 1} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-853688097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a74c43-01ed-442d-ba04-f371da627422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a96faf903c474367a218ce90247471b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:10:51Z,use_quota=True,user_id='2c6d2300bab24ff5a31d9fb312386433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Creating volume 64a74c43-01ed-442d-ba04-f371da627422 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:10:51 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:10:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:10:51 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422 1073741824 Aug 28 20:10:51 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:10:52 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Aug 28 20:10:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422 1073741824" returned: 0 in 0.950s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:10:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:10:52 devstack sudo[86876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422 Aug 28 20:10:52 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:10:53 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root Aug 28 20:10:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422" returned: 0 in 0.642s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:10:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:10:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:10:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61fef49b-94b7-46ad-8165-463292fa74f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a74c43-01ed-442d-ba04-f371da627422', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f21d362-9767-4ae7-a93e-7a9ceb6abf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:10:53 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Volume volume-64a74c43-01ed-442d-ba04-f371da627422 (64a74c43-01ed-442d-ba04-f371da627422): created successfully Aug 28 20:10:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f21d362-9767-4ae7-a93e-7a9ceb6abf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:10:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Flow 'volume_create_manager' (1cbd8b30-411c-4b6b-9d92-930065e4fab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:10:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3dcb9a41-9f07-4127-a349-d266ba4f9697 tempest-DeleteServersTestJSON-1571563854 None] Created volume successfully. Aug 28 20:10:57 devstack cinder-volume[86028]: WARNING py.warnings [req-033dcd17-2479-49f9-bfe6-04ef2754ade6 req-d542469b-839f-43d0-97a8-484645c0bdfb tempest-DeleteServersTestJSON-1571563854 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 28 20:10:57 devstack cinder-volume[86028]: .first() Aug 28 20:10:57 devstack cinder-volume[86028]: Aug 28 20:10:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-033dcd17-2479-49f9-bfe6-04ef2754ade6 req-d542469b-839f-43d0-97a8-484645c0bdfb tempest-DeleteServersTestJSON-1571563854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:10:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-033dcd17-2479-49f9-bfe6-04ef2754ade6 req-d542469b-839f-43d0-97a8-484645c0bdfb tempest-DeleteServersTestJSON-1571563854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:10:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-033dcd17-2479-49f9-bfe6-04ef2754ade6 req-d542469b-839f-43d0-97a8-484645c0bdfb tempest-DeleteServersTestJSON-1571563854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:10:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-033dcd17-2479-49f9-bfe6-04ef2754ade6 req-d542469b-839f-43d0-97a8-484645c0bdfb tempest-DeleteServersTestJSON-1571563854 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-64a74c43-01ed-442d-ba04-f371da627422', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '989545de-0521-4351-8098-d48478207573', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:10:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-033dcd17-2479-49f9-bfe6-04ef2754ade6 req-d542469b-839f-43d0-97a8-484645c0bdfb tempest-DeleteServersTestJSON-1571563854 None] attachment_update completed successfully. Aug 28 20:11:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-4a96a106-a9a8-4806-bf7d-4ed68b378255 req-8446ed2a-2a93-477c-91be-eaa1dc4401b6 tempest-DeleteServersTestJSON-1571563854 None] Terminate volume connection completed successfully. Aug 28 20:11:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-4a96a106-a9a8-4806-bf7d-4ed68b378255 req-8446ed2a-2a93-477c-91be-eaa1dc4401b6 tempest-DeleteServersTestJSON-1571563854 None] Deleting attachment 989545de-0521-4351-8098-d48478207573. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:11:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Acquiring lock "cinder-64a74c43-01ed-442d-ba04-f371da627422-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:11:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Lock "cinder-64a74c43-01ed-442d-ba04-f371da627422-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:11:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Acquiring lock "cinder-quobyte-64a74c43-01ed-442d-ba04-f371da627422" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:11:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Lock "cinder-quobyte-64a74c43-01ed-442d-ba04-f371da627422" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:11:05 devstack cinder-volume[86028]: INFO oslo.privsep.daemon [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfr3d1ktw/privsep.sock'] Aug 28 20:11:05 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfr3d1ktw/privsep.sock Aug 28 20:11:05 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:11:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:11:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:11:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:11:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:11:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:11:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:06 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:11:06 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:07 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.555s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:11:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:11:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 7 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:11:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:11:07 devstack cinder-volume[86028]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 28 20:11:07 devstack cinder-volume[86028]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 28 20:11:07 devstack cinder-volume[86028]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 28 20:11:07 devstack cinder-volume[86028]: WARNING oslo.privsep.daemon [-] privsep log: Aug 28 20:11:07 devstack cinder-volume[86028]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 28 20:11:07 devstack cinder-volume[86028]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 28 20:11:07 devstack cinder-volume[86028]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 28 20:11:07 devstack cinder-volume[86028]: WARNING oslo.privsep.daemon [-] privsep log: Aug 28 20:11:07 devstack cinder-volume[86028]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 28 20:11:08 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:08 devstack cinder-volume[86028]: INFO oslo.privsep.daemon [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Spawned new privsep daemon via rootwrap Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Accepted privsep connection to /tmp/tmpfr3d1ktw/privsep.sock {{(pid=86028) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 28 20:11:08 devstack cinder-volume[86028]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 28 20:11:08 devstack cinder-volume[86028]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 28 20:11:08 devstack cinder-volume[86028]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 28 20:11:08 devstack cinder-volume[86028]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87597 Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[df515f42-7482-49ab-af0c-4a78a4530f48]: (2,) {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b69501e-828f-4e3a-9a91-23b768060d7d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:08 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422 Aug 28 20:11:08 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Flow 'volume_create_manager' (9aa7db08-7d78-4208-96f5-a3de590b11a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e858475-a2f9-4e1c-b5e6-65d0f19b04c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e858475-a2f9-4e1c-b5e6-65d0f19b04c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-539643376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddc5f9f-b8b8-4e80-89c0-8ae18983ea15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1403c601495a4d88be9abf265fc4ee19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:11:09Z,use_quota=True,user_id='7c634bfe4bb645daa455034d90d9df69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822d0eda-3de1-446c-9b8d-3241f12998ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822d0eda-3de1-446c-9b8d-3241f12998ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680c0535-a301-4e95-9ea6-da3989a705d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680c0535-a301-4e95-9ea6-da3989a705d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cddc5f9f-b8b8-4e80-89c0-8ae18983ea15', 'volume_name': 'volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726b46ea-5a10-425f-b060-66a92fcbc6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726b46ea-5a10-425f-b060-66a92fcbc6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:08 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3212eb88-eb2e-4e73-9faf-ab0a28b08d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:08 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Volume cddc5f9f-b8b8-4e80-89c0-8ae18983ea15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15', 'volume_size': 1} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-539643376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddc5f9f-b8b8-4e80-89c0-8ae18983ea15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1403c601495a4d88be9abf265fc4ee19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:11:09Z,use_quota=True,user_id='7c634bfe4bb645daa455034d90d9df69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Creating volume cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:11:08 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422" returned: 0 in 0.775s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:08 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422 Aug 28 20:11:08 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:08 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 1073741824 Aug 28 20:11:08 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:09 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-64a74c43-01ed-442d-ba04-f371da627422" returned: 0 in 0.570s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Lock "cinder-quobyte-64a74c43-01ed-442d-ba04-f371da627422" released by "delete_volume" :: held 3.655s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:11:09 devstack cinder-volume[86028]: WARNING cinder.quota [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:11:09 devstack cinder-volume[86028]: WARNING cinder.quota [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Created reservations ['42e22044-7e53-43e4-b80a-4dd850cd7491', '96652339-5682-4a0a-a87c-87d106a5ba0e', '0fc91494-bb6a-4366-b2ef-6eca4e146ba7', '3dff9b80-d682-4feb-a64b-5b53f2f7e456'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:09 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:11:09 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:09 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 1073741824" returned: 0 in 0.998s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:09 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 Aug 28 20:11:09 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:10 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.516s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:10 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:11:10 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Deleted volume successfully. Aug 28 20:11:10 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15" returned: 0 in 0.389s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:11:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:11:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3b8cfd4e-3d58-4dd5-91ff-cc3b20e16ab9 tempest-DeleteServersTestJSON-1571563854 None] Lock "cinder-64a74c43-01ed-442d-ba04-f371da627422-delete_volume" released by "delete_volume" :: held 4.770s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:11:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3212eb88-eb2e-4e73-9faf-ab0a28b08d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9babf450-7169-4302-a024-0ea5e948e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:10 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Volume volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 (cddc5f9f-b8b8-4e80-89c0-8ae18983ea15): created successfully Aug 28 20:11:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9babf450-7169-4302-a024-0ea5e948e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Flow 'volume_create_manager' (9aa7db08-7d78-4208-96f5-a3de590b11a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:11:10 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8f23b96f-bde7-4fd3-8114-9d8be3d3d739 tempest-VolumesAdminNegativeTest-39560563 None] Created volume successfully. Aug 28 20:11:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Acquiring lock "cinder-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:11:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Lock "cinder-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:11:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Acquiring lock "cinder-quobyte-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:11:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Lock "cinder-quobyte-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15" acquired by "delete_volume" :: waited 0.077s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:11:13 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c7ec15-dc1d-4bd9-b01f-1f01a3d93801]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:11:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:13 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 Aug 28 20:11:13 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:13 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15" returned: 0 in 0.636s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:13 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15 Aug 28 20:11:13 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:14 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15" returned: 0 in 0.377s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Lock "cinder-quobyte-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15" released by "delete_volume" :: held 1.125s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:11:14 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Created reservations ['64d1c304-6c0e-42a3-aa59-36d3a4363db7', '5f3cd968-3749-4d9d-9046-e466ccf8486b', '2daa3306-e24b-46fe-91a1-967ae875efc3', 'aa77bf21-8a80-4252-9c98-d6426ffa4998'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:11:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:11:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:11:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:11:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:11:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:11:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:14 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:11:14 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:15 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.625s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:15 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:11:15 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Deleted volume successfully. Aug 28 20:11:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f5b51d4-8af0-4041-8286-208255112fd7 tempest-VolumesAdminNegativeTest-39560563 None] Lock "cinder-cddc5f9f-b8b8-4e80-89c0-8ae18983ea15-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Flow 'volume_create_manager' (dc67823a-1278-48c9-ac1b-7c55ab3497eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736b6d57-9b0f-495e-9ea2-9e12f9db2046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736b6d57-9b0f-495e-9ea2-9e12f9db2046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-200934978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271774ca-8a86-43a7-8aaa-9a87bf0eab9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='814f746745e64252b6482ab125bf6937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:11:22Z,use_quota=True,user_id='7d025e30c317418a932f798c2cce5b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd2d45a-fe91-40e8-911a-30f808fa3e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd2d45a-fe91-40e8-911a-30f808fa3e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c57e04-1929-4dcc-a635-bc326064df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c57e04-1929-4dcc-a635-bc326064df39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271774ca-8a86-43a7-8aaa-9a87bf0eab9c', 'volume_name': 'volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2380a2c1-7dad-47a0-a752-8d0304fc557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2380a2c1-7dad-47a0-a752-8d0304fc557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e394cf4-3cd7-4854-959d-39a4bcb0d27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:21 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Volume 271774ca-8a86-43a7-8aaa-9a87bf0eab9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c', 'volume_size': 1} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-200934978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271774ca-8a86-43a7-8aaa-9a87bf0eab9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='814f746745e64252b6482ab125bf6937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:11:22Z,use_quota=True,user_id='7d025e30c317418a932f798c2cce5b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Creating volume 271774ca-8a86-43a7-8aaa-9a87bf0eab9c {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:11:21 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:11:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:21 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c 1073741824 Aug 28 20:11:21 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:22 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c 1073741824" returned: 0 in 0.664s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:22 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c Aug 28 20:11:22 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:22 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c" returned: 0 in 0.370s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:11:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:11:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e394cf4-3cd7-4854-959d-39a4bcb0d27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bb09eb-ce70-4dfe-9bb7-d75cb86f4cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:11:23 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Volume volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c (271774ca-8a86-43a7-8aaa-9a87bf0eab9c): created successfully Aug 28 20:11:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bb09eb-ce70-4dfe-9bb7-d75cb86f4cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:11:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Flow 'volume_create_manager' (dc67823a-1278-48c9-ac1b-7c55ab3497eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:11:23 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-fca3998c-c885-4d6f-a8e7-552938150bed req-afbadabe-b55c-4ac6-b267-0b33edcdc4dc tempest-VolumesGetTestJSON-526518183 None] Created volume successfully. Aug 28 20:11:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Acquiring lock "cinder-271774ca-8a86-43a7-8aaa-9a87bf0eab9c-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:11:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Lock "cinder-271774ca-8a86-43a7-8aaa-9a87bf0eab9c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:11:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Acquiring lock "cinder-quobyte-271774ca-8a86-43a7-8aaa-9a87bf0eab9c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:11:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Lock "cinder-quobyte-271774ca-8a86-43a7-8aaa-9a87bf0eab9c" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:11:24 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a6a047-51a1-40fe-bba8-af50286bf029]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:11:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:24 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c Aug 28 20:11:24 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:24 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c" returned: 0 in 0.417s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:25 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c Aug 28 20:11:25 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:25 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-271774ca-8a86-43a7-8aaa-9a87bf0eab9c" returned: 0 in 0.266s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Lock "cinder-quobyte-271774ca-8a86-43a7-8aaa-9a87bf0eab9c" released by "delete_volume" :: held 0.729s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG cinder.quota [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Created reservations ['7b241184-8d9d-4157-8bb5-6426a25848e8', 'd12f9f62-0516-4237-8d78-fea5d4e64ff0', 'b9794c57-bb10-46fa-aa78-b7ebca4bf576', '28f47b3f-0c72-4701-9993-ed2967f02b33'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:11:25 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:11:25 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:11:25 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.279s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG cinder.manager [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:11:25 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Deleted volume successfully. Aug 28 20:11:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-a2286242-c213-4444-aefb-c8a45333440f req-e9dc477f-ef15-4648-aa2d-5780d666eb42 tempest-VolumesGetTestJSON-526518183 None] Lock "cinder-271774ca-8a86-43a7-8aaa-9a87bf0eab9c-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:11:35 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=28,cinder:UPDATE=39,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:11:35 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=30,cinder:SELECT=29,cinder:DELETE=5,cinder:INSERT=7 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:11:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-871c775b-02a1-4b3b-a26e-80a4ae4b96ea req-b4c6e17d-703a-4660-be3a-a090f56b5d99 tempest-TaggedAttachmentsTest-1353595995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:11:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-871c775b-02a1-4b3b-a26e-80a4ae4b96ea req-b4c6e17d-703a-4660-be3a-a090f56b5d99 tempest-TaggedAttachmentsTest-1353595995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:11:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-871c775b-02a1-4b3b-a26e-80a4ae4b96ea req-b4c6e17d-703a-4660-be3a-a090f56b5d99 tempest-TaggedAttachmentsTest-1353595995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:11:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-871c775b-02a1-4b3b-a26e-80a4ae4b96ea req-b4c6e17d-703a-4660-be3a-a090f56b5d99 tempest-TaggedAttachmentsTest-1353595995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-3c477fb6-cf07-4487-90ea-f96ff9d45760', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a33e0179-3aee-47f5-8d80-61743c71ba75', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:11:43 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-871c775b-02a1-4b3b-a26e-80a4ae4b96ea req-b4c6e17d-703a-4660-be3a-a090f56b5d99 tempest-TaggedAttachmentsTest-1353595995 None] attachment_update completed successfully. Aug 28 20:11:47 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-fb98a07f-1632-48e9-8615-77c02ba9aa28 req-06b342ae-e803-4955-ba39-7aeac5636a0d tempest-TaggedAttachmentsTest-1353595995 None] Terminate volume connection completed successfully. Aug 28 20:11:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fb98a07f-1632-48e9-8615-77c02ba9aa28 req-06b342ae-e803-4955-ba39-7aeac5636a0d tempest-TaggedAttachmentsTest-1353595995 None] Deleting attachment a33e0179-3aee-47f5-8d80-61743c71ba75. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:11:53 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:11:57 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:06 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:12:06 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Acquiring lock "cinder-3c477fb6-cf07-4487-90ea-f96ff9d45760-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Lock "cinder-3c477fb6-cf07-4487-90ea-f96ff9d45760-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Acquiring lock "cinder-quobyte-3c477fb6-cf07-4487-90ea-f96ff9d45760" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Lock "cinder-quobyte-3c477fb6-cf07-4487-90ea-f96ff9d45760" acquired by "delete_volume" :: waited 0.035s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[02746663-6f9a-410f-a40b-7e608a15436f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:12:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:07 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760 Aug 28 20:12:07 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:07 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.454s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:12:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:12:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 8 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:12:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:12:07 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760" returned: 0 in 0.548s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:07 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760 Aug 28 20:12:07 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:07 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3c477fb6-cf07-4487-90ea-f96ff9d45760" returned: 0 in 0.349s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Lock "cinder-quobyte-3c477fb6-cf07-4487-90ea-f96ff9d45760" released by "delete_volume" :: held 0.998s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:12:07 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Created reservations ['39a1e800-ae88-41f3-b52d-7c7ce69513e8', '19865298-b020-4b3f-b2f6-501f832de9bf', 'c104ed6a-58f0-4e49-8cde-04fe7b8cd8e1', '6a4a1b58-250a-4818-8299-88ad34e2ee9e'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:12:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:12:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:12:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:08 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:12:08 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:08 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.327s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:08 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:12:08 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Deleted volume successfully. Aug 28 20:12:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-63ede1ce-1f98-4c41-833d-bbaa265277b0 tempest-TaggedAttachmentsTest-1353595995 None] Lock "cinder-3c477fb6-cf07-4487-90ea-f96ff9d45760-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Flow 'volume_create_manager' (69b19dc6-4229-44fc-b0bf-0c7a1ef4eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67e2331-bca5-4aa2-88de-07ff02c48545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67e2331-bca5-4aa2-88de-07ff02c48545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-574523127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc42902e-6b35-40a7-9223-3b82b4a1194c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4321d00daea64238924652d812234176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:12:10Z,use_quota=True,user_id='bd28f688356e4d7f9994d8a6c56a0388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ec8627-47cc-468f-a3c6-532f4f77ce9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ec8627-47cc-468f-a3c6-532f4f77ce9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4faa73a9-a061-4765-b0fe-844e1244de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4faa73a9-a061-4765-b0fe-844e1244de87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc42902e-6b35-40a7-9223-3b82b4a1194c', 'volume_name': 'volume-cc42902e-6b35-40a7-9223-3b82b4a1194c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c50d966-6d85-44ef-97f1-400c1441621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c50d966-6d85-44ef-97f1-400c1441621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a03d1c-fc0d-44b0-92c3-14297de1331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:10 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Volume cc42902e-6b35-40a7-9223-3b82b4a1194c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc42902e-6b35-40a7-9223-3b82b4a1194c', 'volume_size': 1} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-574523127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc42902e-6b35-40a7-9223-3b82b4a1194c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4321d00daea64238924652d812234176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:12:10Z,use_quota=True,user_id='bd28f688356e4d7f9994d8a6c56a0388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Creating volume cc42902e-6b35-40a7-9223-3b82b4a1194c {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:12:10 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:12:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:10 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c 1073741824 Aug 28 20:12:10 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:11 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c 1073741824" returned: 0 in 0.853s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:11 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c Aug 28 20:12:11 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:11 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c" returned: 0 in 0.435s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:12:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a03d1c-fc0d-44b0-92c3-14297de1331f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc42902e-6b35-40a7-9223-3b82b4a1194c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfa090e-cb6b-4808-af90-c80be0138862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:11 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Volume volume-cc42902e-6b35-40a7-9223-3b82b4a1194c (cc42902e-6b35-40a7-9223-3b82b4a1194c): created successfully Aug 28 20:12:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfa090e-cb6b-4808-af90-c80be0138862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Flow 'volume_create_manager' (69b19dc6-4229-44fc-b0bf-0c7a1ef4eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:12:11 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ddff3f3b-4c55-47b6-989f-4b232f131c17 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Created volume successfully. Aug 28 20:12:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Acquiring lock "cinder-cc42902e-6b35-40a7-9223-3b82b4a1194c-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:12:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Lock "cinder-cc42902e-6b35-40a7-9223-3b82b4a1194c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:12:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Acquiring lock "cinder-quobyte-cc42902e-6b35-40a7-9223-3b82b4a1194c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:12:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Lock "cinder-quobyte-cc42902e-6b35-40a7-9223-3b82b4a1194c" acquired by "delete_volume" :: waited 0.033s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:12:14 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9f45df-9376-4624-896c-97ae8b7f2f48]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:12:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:15 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c Aug 28 20:12:15 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:15 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c" returned: 0 in 0.539s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:15 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c Aug 28 20:12:15 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:15 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc42902e-6b35-40a7-9223-3b82b4a1194c" returned: 0 in 0.311s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Lock "cinder-quobyte-cc42902e-6b35-40a7-9223-3b82b4a1194c" released by "delete_volume" :: held 0.924s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:12:15 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Created reservations ['83ea579d-f878-4ada-ad71-a2415d8cd7e9', 'b39abeb2-e748-4d5e-bc7f-cf47866a0673', '74016cc5-5f51-40a7-8e06-6e3c8fc2e504', '846c8ae9-89a5-4aa7-9185-c9414f7f2bfc'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:12:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:12:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:12:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:16 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:12:16 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:16 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.650s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:16 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:12:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Deleted volume successfully. Aug 28 20:12:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-398d6c8f-d718-4785-bb20-53d1e6ce3ce1 tempest-VolumeQuotasNegativeTestJSON-960951687 None] Lock "cinder-cc42902e-6b35-40a7-9223-3b82b4a1194c-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Flow 'volume_create_manager' (1307b231-9591-4924-81a3-00bf7d2dd310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f256c2-c74c-42ef-b589-5196af99acce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f256c2-c74c-42ef-b589-5196af99acce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1643470406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d88edd-df62-44f2-8197-305e598f397c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74cd6d2c15a4986b8954f7ccb28cb6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:12:17Z,use_quota=True,user_id='8e2411acf0464f7b83abe83092712c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d9f7fd-e3cd-466b-88f9-740c5de5f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d9f7fd-e3cd-466b-88f9-740c5de5f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad8c2d4-f922-4f43-ae52-e0df52643911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad8c2d4-f922-4f43-ae52-e0df52643911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d88edd-df62-44f2-8197-305e598f397c', 'volume_name': 'volume-29d88edd-df62-44f2-8197-305e598f397c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e7b4f8-2c3a-413f-a1e7-550b8b9bd0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e7b4f8-2c3a-413f-a1e7-550b8b9bd0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081ce9b5-a0c0-4e4e-82a4-2ef7ff91a474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:17 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Volume 29d88edd-df62-44f2-8197-305e598f397c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d88edd-df62-44f2-8197-305e598f397c', 'volume_size': 1} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1643470406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d88edd-df62-44f2-8197-305e598f397c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c74cd6d2c15a4986b8954f7ccb28cb6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:12:17Z,use_quota=True,user_id='8e2411acf0464f7b83abe83092712c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Creating volume 29d88edd-df62-44f2-8197-305e598f397c {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:12:17 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:12:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:17 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c 1073741824 Aug 28 20:12:17 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:18 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c 1073741824" returned: 0 in 1.052s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:18 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c Aug 28 20:12:18 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:19 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c" returned: 0 in 0.384s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:12:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081ce9b5-a0c0-4e4e-82a4-2ef7ff91a474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d88edd-df62-44f2-8197-305e598f397c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ec536a-4e4c-45a0-8a07-571640172482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:19 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Volume volume-29d88edd-df62-44f2-8197-305e598f397c (29d88edd-df62-44f2-8197-305e598f397c): created successfully Aug 28 20:12:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14ec536a-4e4c-45a0-8a07-571640172482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Flow 'volume_create_manager' (1307b231-9591-4924-81a3-00bf7d2dd310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:12:19 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-527edcb5-fc67-462c-9cab-193e6f7163e9 tempest-AttachVolumeShelveTestJSON-1274525735 None] Created volume successfully. Aug 28 20:12:24 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:12:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Flow 'volume_create_manager' (67ce29cf-8139-4d3f-8899-9addedb96bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:12:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47c8307-0398-4512-b4a0-ed81fd395ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47c8307-0398-4512-b4a0-ed81fd395ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-278130101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df36e76-bbfc-4317-86e4-2e4d8505fcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806914fe5c7a40fb91846603086e6f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:12:25Z,use_quota=True,user_id='1e0feb1a749a4a3a8c2638d14eafab16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004cddd4-4a04-4f8a-8f15-225f71119da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004cddd4-4a04-4f8a-8f15-225f71119da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457dba04-386f-4334-afa9-250ddee85335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457dba04-386f-4334-afa9-250ddee85335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df36e76-bbfc-4317-86e4-2e4d8505fcd9', 'volume_name': 'volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a951963c-1e70-499b-a663-d1cf65f9ae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a951963c-1e70-499b-a663-d1cf65f9ae6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b949c723-2041-441a-b8e8-4b93bcf6d528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:25 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Volume 7df36e76-bbfc-4317-86e4-2e4d8505fcd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9', 'volume_size': 1} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-278130101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df36e76-bbfc-4317-86e4-2e4d8505fcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806914fe5c7a40fb91846603086e6f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:12:25Z,use_quota=True,user_id='1e0feb1a749a4a3a8c2638d14eafab16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Creating volume 7df36e76-bbfc-4317-86e4-2e4d8505fcd9 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:12:25 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:12:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:25 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9 1073741824 Aug 28 20:12:25 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:26 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9 1073741824" returned: 0 in 0.934s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:26 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9 Aug 28 20:12:26 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:26 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9" returned: 0 in 0.476s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:12:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b949c723-2041-441a-b8e8-4b93bcf6d528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d3d95a-8a81-42fd-ba20-faecca50b3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:26 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Volume volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9 (7df36e76-bbfc-4317-86e4-2e4d8505fcd9): created successfully Aug 28 20:12:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d3d95a-8a81-42fd-ba20-faecca50b3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Flow 'volume_create_manager' (67ce29cf-8139-4d3f-8899-9addedb96bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:12:26 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fd74cb5f-5f33-4c6d-82f7-2dae51c82346 tempest-ServerRescueNegativeTestJSON-1023060765 None] Created volume successfully. Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Flow 'volume_create_manager' (98c39239-a3ee-48df-882b-d61e699a1295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b01e52-31d2-4607-88a1-98012b88e35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b01e52-31d2-4607-88a1-98012b88e35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1868966686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39a6032-e198-4aa6-bc54-0e62865b0baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3107d003864c2b8b9080adcd9a52ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:12:29Z,use_quota=True,user_id='a2cff22ef2f048c98d366e4c817d2f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c295a75-0181-4ed5-8d60-75278845dc3d),volume_type_id=6c295a75-0181-4ed5-8d60-75278845dc3d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3b5532-6dab-4ada-8779-a0f43fc1e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3b5532-6dab-4ada-8779-a0f43fc1e178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a403f5c-ba54-4f4c-a90d-ac87f86aaf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a403f5c-ba54-4f4c-a90d-ac87f86aaf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39a6032-e198-4aa6-bc54-0e62865b0baa', 'volume_name': 'volume-c39a6032-e198-4aa6-bc54-0e62865b0baa', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2449e64d-e518-46f2-984f-15f4ba6fdefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2449e64d-e518-46f2-984f-15f4ba6fdefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdf7464-01fd-4978-ae21-241cbe96123f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:28 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Volume c39a6032-e198-4aa6-bc54-0e62865b0baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39a6032-e198-4aa6-bc54-0e62865b0baa', 'volume_size': 1} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1868966686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39a6032-e198-4aa6-bc54-0e62865b0baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d3107d003864c2b8b9080adcd9a52ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:12:29Z,use_quota=True,user_id='a2cff22ef2f048c98d366e4c817d2f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c295a75-0181-4ed5-8d60-75278845dc3d),volume_type_id=6c295a75-0181-4ed5-8d60-75278845dc3d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Creating volume c39a6032-e198-4aa6-bc54-0e62865b0baa {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:12:28 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:12:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:28 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa 1073741824 Aug 28 20:12:28 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:29 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa 1073741824" returned: 0 in 0.821s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:29 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa Aug 28 20:12:29 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:30 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa" returned: 0 in 0.552s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:12:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bdf7464-01fd-4978-ae21-241cbe96123f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39a6032-e198-4aa6-bc54-0e62865b0baa', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56db230-dfd9-49e9-8651-77e518eb6cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:12:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Volume volume-c39a6032-e198-4aa6-bc54-0e62865b0baa (c39a6032-e198-4aa6-bc54-0e62865b0baa): created successfully Aug 28 20:12:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56db230-dfd9-49e9-8651-77e518eb6cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:12:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Flow 'volume_create_manager' (98c39239-a3ee-48df-882b-d61e699a1295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:12:30 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3305daaf-2c23-4927-9961-ea5e8b3a4041 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Created volume successfully. Aug 28 20:12:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dca87848-cc4f-44d3-a3b4-f3065565422c tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dca87848-cc4f-44d3-a3b4-f3065565422c tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-dca87848-cc4f-44d3-a3b4-f3065565422c tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:12:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-dca87848-cc4f-44d3-a3b4-f3065565422c tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:12:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dca87848-cc4f-44d3-a3b4-f3065565422c tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dca87848-cc4f-44d3-a3b4-f3065565422c tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:31 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:12:31 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:32 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dca87848-cc4f-44d3-a3b4-f3065565422c tempest-VolumeRetypeWithoutMigrationTest-684726340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.356s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:32 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-dca87848-cc4f-44d3-a3b4-f3065565422c tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:12:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-dca87848-cc4f-44d3-a3b4-f3065565422c tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Retype volume completed successfully. Aug 28 20:12:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Acquiring lock "cinder-c39a6032-e198-4aa6-bc54-0e62865b0baa-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:12:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "cinder-c39a6032-e198-4aa6-bc54-0e62865b0baa-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:12:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Acquiring lock "cinder-quobyte-c39a6032-e198-4aa6-bc54-0e62865b0baa" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:12:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "cinder-quobyte-c39a6032-e198-4aa6-bc54-0e62865b0baa" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:12:33 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4288be29-aa6b-4b69-9d2f-aa4e294a5df4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:12:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:33 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa Aug 28 20:12:33 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:34 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa" returned: 0 in 0.698s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:34 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa Aug 28 20:12:34 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:34 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c39a6032-e198-4aa6-bc54-0e62865b0baa" returned: 0 in 0.791s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "cinder-quobyte-c39a6032-e198-4aa6-bc54-0e62865b0baa" released by "delete_volume" :: held 1.563s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:12:35 devstack cinder-volume[86028]: WARNING cinder.quota [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:12:35 devstack cinder-volume[86028]: WARNING cinder.quota [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:12:35 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Created reservations ['daa99dca-b4bf-4903-b2ff-43609e756a46', '5a1ec575-005e-4998-a5ff-e18baa9ea168', 'c6a754cf-e72e-410f-8df4-c1443c343961', '53af9944-8353-4e8d-b291-b78d00cb43e3'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:12:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:12:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:12:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:35 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:12:35 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:36 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.984s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:36 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:12:36 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Deleted volume successfully. Aug 28 20:12:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-165af447-ca28-4dc8-b623-96414fa61937 tempest-VolumeRetypeWithoutMigrationTest-684726340 None] Lock "cinder-c39a6032-e198-4aa6-bc54-0e62865b0baa-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:12:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-c92f8098-dcd8-4973-80ce-5594630f8944 req-3a08c1e3-ceaa-4b2a-8093-2ac92b072fba tempest-AttachVolumeShelveTestJSON-1274525735 None] No connector for attachment 32f44b7b-9f3a-4042-b806-5bda303672d6; skipping storage backend terminate_connection call. {{(pid=86028) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 28 20:12:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-c92f8098-dcd8-4973-80ce-5594630f8944 req-3a08c1e3-ceaa-4b2a-8093-2ac92b072fba tempest-AttachVolumeShelveTestJSON-1274525735 None] Deleting attachment 32f44b7b-9f3a-4042-b806-5bda303672d6. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:12:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Acquiring lock "cinder-7df36e76-bbfc-4317-86e4-2e4d8505fcd9-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:12:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Lock "cinder-7df36e76-bbfc-4317-86e4-2e4d8505fcd9-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:12:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Acquiring lock "cinder-quobyte-7df36e76-bbfc-4317-86e4-2e4d8505fcd9" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:12:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Lock "cinder-quobyte-7df36e76-bbfc-4317-86e4-2e4d8505fcd9" acquired by "delete_volume" :: waited 0.043s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:12:42 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c089d777-e0ab-4573-aa9e-dd0504248d6d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:12:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:42 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9 Aug 28 20:12:42 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:42 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9" returned: 0 in 0.540s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:42 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9 Aug 28 20:12:42 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:43 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7df36e76-bbfc-4317-86e4-2e4d8505fcd9" returned: 0 in 0.613s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Lock "cinder-quobyte-7df36e76-bbfc-4317-86e4-2e4d8505fcd9" released by "delete_volume" :: held 1.284s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:12:43 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Created reservations ['dcd15069-6baa-4c60-897d-ba1941204616', '25be1438-9100-48db-a293-e599507dbd43', '819a3377-cfa7-45f6-9c64-9f06acbe16be', 'c073dfac-c34e-4f8a-8b3c-6edcd8fe11fc'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:12:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:12:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:12:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:12:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:12:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:12:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:12:43 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:12:43 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:12:44 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Aug 28 20:12:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.739s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:12:44 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:12:44 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Deleted volume successfully. Aug 28 20:12:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2763920c-353b-4c22-ba24-3d410836a2ef tempest-ServerRescueNegativeTestJSON-1023060765 None] Lock "cinder-7df36e76-bbfc-4317-86e4-2e4d8505fcd9-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:12:53 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=37,cinder:INSERT=7,cinder:UPDATE=51,cinder:DELETE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:12:54 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=46,cinder:SELECT=35,cinder:INSERT=13,cinder:DELETE=7 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:13:00 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:13:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Flow 'volume_create_manager' (496b05be-d752-471e-857d-589afe637c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1db835-fcef-417e-b9d2-3f74ab3963d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1db835-fcef-417e-b9d2-3f74ab3963d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-801933422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e990b2de-0b72-40b9-a75f-0bb46a7e27e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972f56ab0fa14f978fac2e5dc0dfdb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:01Z,use_quota=True,user_id='acf9f405e0e749fb9eacdcb287e19ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c342a7-dd4c-41a1-8215-660a6c6ccaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c342a7-dd4c-41a1-8215-660a6c6ccaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a479a5-77d1-4455-83e2-80f3c9a0cbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:00 devstack cinder-volume[86028]: DEBUG cinder.image.glance [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Creating Keystone auth plugin from conf {{(pid=86028) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 20:13:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a479a5-77d1-4455-83e2-80f3c9a0cbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e990b2de-0b72-40b9-a75f-0bb46a7e27e1', 'volume_name': 'volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76829cf3-b757-4fd3-870f-81d80ee7ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76829cf3-b757-4fd3-870f-81d80ee7ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb89cbc2-01d2-4920-bfcc-5e69abdfbd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:01 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Volume e990b2de-0b72-40b9-a75f-0bb46a7e27e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 20:13:01 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Trying to clone e990b2de-0b72-40b9-a75f-0bb46a7e27e1 from image b69357c8-f1c6-42fd-802c-792fbb69d92d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]). {{(pid=86028) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 20:13:02 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 20:13:02 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Image download 20.69 MB at 20.69 MB/s Aug 28 20:13:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb8c75-2687-49a6-a20c-c26019cf8734]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:02 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD Aug 28 20:13:02 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:02 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD" returned: 0 in 0.612s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:02 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Temporary image b69357c8-f1c6-42fd-802c-792fbb69d92d is fetched for user acf9f405e0e749fb9eacdcb287e19ded. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db1d1b5-6bc4-42a8-8931-d89f50106957]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:03 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD Aug 28 20:13:03 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:03 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD" returned: 0 in 0.636s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-801933422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e990b2de-0b72-40b9-a75f-0bb46a7e27e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972f56ab0fa14f978fac2e5dc0dfdb13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:01Z,use_quota=True,user_id='acf9f405e0e749fb9eacdcb287e19ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Creating volume e990b2de-0b72-40b9-a75f-0bb46a7e27e1 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:13:03 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:13:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:03 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 1073741824 Aug 28 20:13:03 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:04 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 1073741824" returned: 0 in 0.620s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:04 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 Aug 28 20:13:04 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:05 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1" returned: 0 in 0.746s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:13:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:05 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Attempting download of b69357c8-f1c6-42fd-802c-792fbb69d92d ((None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}])) to volume e990b2de-0b72-40b9-a75f-0bb46a7e27e1. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 20:13:05 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8cd54b-35e4-4019-ad0a-94e3d99ac60e]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d__5zkzqp2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:05 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d__5zkzqp2 Aug 28 20:13:05 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:06 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d__5zkzqp2" returned: 0 in 0.850s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d__5zkzqp2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:06 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d__5zkzqp2 Aug 28 20:13:06 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:13:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:06 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:06 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:07 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.489s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:13:07 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d__5zkzqp2" returned: 1 in 0.837s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d__5zkzqp2' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d437e7-1a2a-4079-9947-ae8c3609cdbb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:07 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD Aug 28 20:13:07 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:07 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD" returned: 0 in 0.576s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] b69357c8-f1c6-42fd-802c-792fbb69d92d was qcow2, converting to qcow2 {{(pid=86028) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 20:13:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:07 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 Aug 28 20:13:07 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Flow 'volume_create_manager' (ffed4ec8-a21d-4985-8c4e-271a6e816117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5441f4b4-ca43-4ee6-9a7d-c342f9e4f994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5441f4b4-ca43-4ee6-9a7d-c342f9e4f994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1166326704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f88a856-546d-438f-8f58-c006e69fb5d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b78bb78ce3496791bfc7413135a0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:10Z,use_quota=True,user_id='0c4fb9df26b2429c8087be95eebdc9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3abeee7-dd3c-4bf4-a4ce-b6477f5c39c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3abeee7-dd3c-4bf4-a4ce-b6477f5c39c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e4e5d5-d0c3-411f-b891-f5914e65d8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e4e5d5-d0c3-411f-b891-f5914e65d8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f88a856-546d-438f-8f58-c006e69fb5d8', 'volume_name': 'volume-9f88a856-546d-438f-8f58-c006e69fb5d8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c073a78-a33d-4cf5-a714-6045d3dbd6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c073a78-a33d-4cf5-a714-6045d3dbd6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40f3711-67c9-4eee-b880-b6e496083fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:10 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Volume 9f88a856-546d-438f-8f58-c006e69fb5d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f88a856-546d-438f-8f58-c006e69fb5d8', 'volume_size': 1} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1166326704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f88a856-546d-438f-8f58-c006e69fb5d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b78bb78ce3496791bfc7413135a0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:10Z,use_quota=True,user_id='0c4fb9df26b2429c8087be95eebdc9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Creating volume 9f88a856-546d-438f-8f58-c006e69fb5d8 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:13:10 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:10 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8 1073741824 Aug 28 20:13:10 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:10 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1" returned: 0 in 2.964s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_38jgxse3devstack@QuobyteHD, size 112.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:13:10 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Converted 112.00 MB image at 37.77 MB/s Aug 28 20:13:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:10 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 1G Aug 28 20:13:10 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:11 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8 1073741824" returned: 0 in 0.590s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:11 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 1G" returned: 0 in 0.389s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Downloaded image b69357c8-f1c6-42fd-802c-792fbb69d92d ((None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}])) to volume e990b2de-0b72-40b9-a75f-0bb46a7e27e1 successfully. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Temporary image b69357c8-f1c6-42fd-802c-792fbb69d92d for user acf9f405e0e749fb9eacdcb287e19ded is deleted. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Marking volume e990b2de-0b72-40b9-a75f-0bb46a7e27e1 as bootable. {{(pid=86028) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Copying metadata from image b69357c8-f1c6-42fd-802c-792fbb69d92d to e990b2de-0b72-40b9-a75f-0bb46a7e27e1. {{(pid=86028) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Creating volume glance metadata for volume e990b2de-0b72-40b9-a75f-0bb46a7e27e1 backed by image b69357c8-f1c6-42fd-802c-792fbb69d92d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86028) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 20:13:11 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8 Aug 28 20:13:11 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb89cbc2-01d2-4920-bfcc-5e69abdfbd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72972c7a-e7ac-496b-86a0-95760c9b38e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:11 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Volume volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 (e990b2de-0b72-40b9-a75f-0bb46a7e27e1): created successfully Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72972c7a-e7ac-496b-86a0-95760c9b38e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Flow 'volume_create_manager' (496b05be-d752-471e-857d-589afe637c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:11 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-365cb75b-3da1-477a-834f-e8c2129a321c tempest-VolumesImageMetadata-2079760406 None] Created volume successfully. Aug 28 20:13:11 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8" returned: 0 in 0.322s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40f3711-67c9-4eee-b880-b6e496083fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f88a856-546d-438f-8f58-c006e69fb5d8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aac3bbe-a1d9-45e4-8918-00ddcb033077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:11 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Volume volume-9f88a856-546d-438f-8f58-c006e69fb5d8 (9f88a856-546d-438f-8f58-c006e69fb5d8): created successfully Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aac3bbe-a1d9-45e4-8918-00ddcb033077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Flow 'volume_create_manager' (ffed4ec8-a21d-4985-8c4e-271a6e816117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:11 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3dadc1b8-7766-47dc-a14d-526b7c12eabc tempest-VolumesTestJSON-2071062678 None] Created volume successfully. Aug 28 20:13:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Acquiring lock "cinder-e990b2de-0b72-40b9-a75f-0bb46a7e27e1-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Lock "cinder-e990b2de-0b72-40b9-a75f-0bb46a7e27e1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Acquiring lock "cinder-quobyte-e990b2de-0b72-40b9-a75f-0bb46a7e27e1" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Lock "cinder-quobyte-e990b2de-0b72-40b9-a75f-0bb46a7e27e1" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:12 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea393dff-e9cb-4eea-bfe2-23e13bfa2f03]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:12 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 Aug 28 20:13:12 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:12 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1" returned: 0 in 0.540s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:12 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1 Aug 28 20:13:12 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:13:13 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Flow 'volume_create_manager' (50b3783b-a495-4870-8b64-a04a8e86f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b01c56b-9f37-4466-b886-93612403dbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e990b2de-0b72-40b9-a75f-0bb46a7e27e1" returned: 0 in 0.367s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b01c56b-9f37-4466-b886-93612403dbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1894223005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31996de4-c61d-4f05-aca6-aed277eb3fca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b78bb78ce3496791bfc7413135a0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:13Z,use_quota=True,user_id='0c4fb9df26b2429c8087be95eebdc9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e540545-5482-42cd-a661-74b2358bb943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e540545-5482-42cd-a661-74b2358bb943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60b54cf-0011-44be-b849-241d746468d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60b54cf-0011-44be-b849-241d746468d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31996de4-c61d-4f05-aca6-aed277eb3fca', 'volume_name': 'volume-31996de4-c61d-4f05-aca6-aed277eb3fca', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fcb612-e625-49c9-82da-9c6829885dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fcb612-e625-49c9-82da-9c6829885dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f0d36f-0b09-415b-8c3e-7821e9cd30c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:13 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Volume 31996de4-c61d-4f05-aca6-aed277eb3fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31996de4-c61d-4f05-aca6-aed277eb3fca', 'volume_size': 1} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1894223005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31996de4-c61d-4f05-aca6-aed277eb3fca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b78bb78ce3496791bfc7413135a0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:13Z,use_quota=True,user_id='0c4fb9df26b2429c8087be95eebdc9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Creating volume 31996de4-c61d-4f05-aca6-aed277eb3fca {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:13:13 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Lock "cinder-quobyte-e990b2de-0b72-40b9-a75f-0bb46a7e27e1" released by "delete_volume" :: held 1.027s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:13 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca 1073741824 Aug 28 20:13:13 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Created reservations ['3d597bdd-6274-40b4-813f-6de6e1d77f70', '0b27a6ce-c5e9-40fd-a206-8b43adeae538', 'aad2b94e-966c-46b2-b173-50bc78e2e27e', '154ca6eb-a064-4530-be13-c1c11a46f9fd'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:13 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:13 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:14 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca 1073741824" returned: 0 in 0.707s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:14 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.577s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:14 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca Aug 28 20:13:14 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Deleted volume successfully. Aug 28 20:13:14 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4bf7defb-75e8-4d4d-9bda-d7ffae841324 tempest-VolumesImageMetadata-2079760406 None] Lock "cinder-e990b2de-0b72-40b9-a75f-0bb46a7e27e1-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:14 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca" returned: 0 in 0.260s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f0d36f-0b09-415b-8c3e-7821e9cd30c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31996de4-c61d-4f05-aca6-aed277eb3fca', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c9a10e-e186-4b92-bcea-01143642059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:14 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Volume volume-31996de4-c61d-4f05-aca6-aed277eb3fca (31996de4-c61d-4f05-aca6-aed277eb3fca): created successfully Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c9a10e-e186-4b92-bcea-01143642059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Flow 'volume_create_manager' (50b3783b-a495-4870-8b64-a04a8e86f053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:14 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2a0027ce-824f-49fa-9de6-0d7a9aab8c76 tempest-VolumesTestJSON-2071062678 None] Created volume successfully. Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Flow 'volume_create_manager' (6a3236c6-e402-4393-bb49-d47c059b027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc7cf18-b34b-4f38-9e7d-e00c7d8dd998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc7cf18-b34b-4f38-9e7d-e00c7d8dd998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1583810973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ee3cd4-ccf5-4704-9540-524665602aaf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b78bb78ce3496791bfc7413135a0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:16Z,use_quota=True,user_id='0c4fb9df26b2429c8087be95eebdc9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde67206-ebdb-440f-81b6-f0bd7a7450dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde67206-ebdb-440f-81b6-f0bd7a7450dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8892dee9-e460-4ded-a8ea-8a8d278d2fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8892dee9-e460-4ded-a8ea-8a8d278d2fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ee3cd4-ccf5-4704-9540-524665602aaf', 'volume_name': 'volume-86ee3cd4-ccf5-4704-9540-524665602aaf', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7146dcf7-eb0d-428b-8a3d-a957e1340011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7146dcf7-eb0d-428b-8a3d-a957e1340011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e21589-1d00-4ffa-a271-4ce30cca5cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:15 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Volume 86ee3cd4-ccf5-4704-9540-524665602aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ee3cd4-ccf5-4704-9540-524665602aaf', 'volume_size': 1} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1583810973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ee3cd4-ccf5-4704-9540-524665602aaf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9b78bb78ce3496791bfc7413135a0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:16Z,use_quota=True,user_id='0c4fb9df26b2429c8087be95eebdc9a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Creating volume 86ee3cd4-ccf5-4704-9540-524665602aaf {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:13:15 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:13:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:16 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf 1073741824 Aug 28 20:13:16 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:16 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf 1073741824" returned: 0 in 0.481s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:16 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf Aug 28 20:13:16 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:16 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf" returned: 0 in 0.289s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:13:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e21589-1d00-4ffa-a271-4ce30cca5cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ee3cd4-ccf5-4704-9540-524665602aaf', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeaae105-bd9d-44ee-a31e-f1a46d03e33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:16 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Volume volume-86ee3cd4-ccf5-4704-9540-524665602aaf (86ee3cd4-ccf5-4704-9540-524665602aaf): created successfully Aug 28 20:13:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeaae105-bd9d-44ee-a31e-f1a46d03e33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Flow 'volume_create_manager' (6a3236c6-e402-4393-bb49-d47c059b027e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-27bcb951-15d5-4bb2-8c94-b2d3c8190001 tempest-VolumesTestJSON-2071062678 None] Created volume successfully. Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Flow 'volume_create_manager' (0fa260c9-ddf5-4ee1-8028-608a9195db74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86ed37f-3ecc-440d-aa58-244404310679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86ed37f-3ecc-440d-aa58-244404310679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-985852549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89a15c6-02a7-4421-9390-add37e41c119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906737b7c2f044c2ac69d1b1d2d3ca81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:19Z,use_quota=True,user_id='ecb849a6c5404ab78b519d55d2731a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d264a875-ef30-4146-8a04-286f7f219ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d264a875-ef30-4146-8a04-286f7f219ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f89ec2c-e0f2-44ea-b8c2-ec13489c0e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f89ec2c-e0f2-44ea-b8c2-ec13489c0e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89a15c6-02a7-4421-9390-add37e41c119', 'volume_name': 'volume-a89a15c6-02a7-4421-9390-add37e41c119', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42cc9c3-91d1-4927-b22a-65657a2c8258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42cc9c3-91d1-4927-b22a-65657a2c8258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6100d06-0de7-4503-8160-85440347cd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:18 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Volume a89a15c6-02a7-4421-9390-add37e41c119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89a15c6-02a7-4421-9390-add37e41c119', 'volume_size': 1} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-985852549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89a15c6-02a7-4421-9390-add37e41c119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906737b7c2f044c2ac69d1b1d2d3ca81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:19Z,use_quota=True,user_id='ecb849a6c5404ab78b519d55d2731a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Creating volume a89a15c6-02a7-4421-9390-add37e41c119 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:13:18 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:13:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:18 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119 1073741824 Aug 28 20:13:18 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Acquiring lock "cinder-86ee3cd4-ccf5-4704-9540-524665602aaf-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Lock "cinder-86ee3cd4-ccf5-4704-9540-524665602aaf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Acquiring lock "cinder-quobyte-86ee3cd4-ccf5-4704-9540-524665602aaf" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Lock "cinder-quobyte-86ee3cd4-ccf5-4704-9540-524665602aaf" acquired by "delete_volume" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e412c6cf-9ec7-47da-a50c-b1015c037cf6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:19 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf Aug 28 20:13:19 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:19 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119 1073741824" returned: 0 in 0.536s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:19 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119 Aug 28 20:13:19 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:19 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf" returned: 0 in 0.399s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:19 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf Aug 28 20:13:19 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:19 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119" returned: 0 in 0.283s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6100d06-0de7-4503-8160-85440347cd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89a15c6-02a7-4421-9390-add37e41c119', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca0ccf2-2de9-488c-bb54-d1dd86a3a3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:19 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Volume volume-a89a15c6-02a7-4421-9390-add37e41c119 (a89a15c6-02a7-4421-9390-add37e41c119): created successfully Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca0ccf2-2de9-488c-bb54-d1dd86a3a3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Flow 'volume_create_manager' (0fa260c9-ddf5-4ee1-8028-608a9195db74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:19 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-82deaf8a-87b0-4540-a85b-249d7af99202 tempest-AbsoluteLimitsTests-752491645 None] Created volume successfully. Aug 28 20:13:19 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-86ee3cd4-ccf5-4704-9540-524665602aaf" returned: 0 in 0.260s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Lock "cinder-quobyte-86ee3cd4-ccf5-4704-9540-524665602aaf" released by "delete_volume" :: held 0.713s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Created reservations ['5d5de4a5-c9f4-4b32-9463-cce4789c4b2d', 'f08a35e7-a156-400f-936b-49a45ba8163d', 'e759da7a-3c7c-4b3f-9aee-d0feef7d801c', '3c14e785-3377-475f-9931-c2a548196965'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:20 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:20 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:20 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Acquiring lock "cinder-31996de4-c61d-4f05-aca6-aed277eb3fca-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.291s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:20 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Deleted volume successfully. Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Lock "cinder-31996de4-c61d-4f05-aca6-aed277eb3fca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-09a8d44f-82ad-48c5-9db2-64239e2802af tempest-VolumesTestJSON-2071062678 None] Lock "cinder-86ee3cd4-ccf5-4704-9540-524665602aaf-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Acquiring lock "cinder-quobyte-31996de4-c61d-4f05-aca6-aed277eb3fca" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Lock "cinder-quobyte-31996de4-c61d-4f05-aca6-aed277eb3fca" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[34399863-f446-44fb-8ba8-78873aa7d991]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:20 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca Aug 28 20:13:20 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:20 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca" returned: 0 in 0.427s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:20 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca Aug 28 20:13:20 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Acquiring lock "cinder-a89a15c6-02a7-4421-9390-add37e41c119-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Lock "cinder-a89a15c6-02a7-4421-9390-add37e41c119-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:21 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31996de4-c61d-4f05-aca6-aed277eb3fca" returned: 0 in 0.369s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Acquiring lock "cinder-quobyte-a89a15c6-02a7-4421-9390-add37e41c119" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Lock "cinder-quobyte-31996de4-c61d-4f05-aca6-aed277eb3fca" released by "delete_volume" :: held 0.841s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Lock "cinder-quobyte-a89a15c6-02a7-4421-9390-add37e41c119" acquired by "delete_volume" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9e791d-2329-482c-83d3-ccf8c78b895e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Created reservations ['eb8f4062-715e-48a9-ab4d-7eb8d29de9f5', '238a3f3e-fa5b-4d32-8cfa-6acfc0bda79e', 'e07f5be7-0116-4a76-855b-c587054eadd4', 'ca11caf5-3093-41c3-92f0-a0f594dbfd52'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:21 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119 Aug 28 20:13:21 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:21 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:21 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Acquiring lock "cinder-9f88a856-546d-438f-8f58-c006e69fb5d8-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Lock "cinder-9f88a856-546d-438f-8f58-c006e69fb5d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Acquiring lock "cinder-quobyte-9f88a856-546d-438f-8f58-c006e69fb5d8" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Lock "cinder-quobyte-9f88a856-546d-438f-8f58-c006e69fb5d8" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[041d37ce-4f0c-4bc2-93e0-c72ce56275f9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:21 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:21 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8 Aug 28 20:13:21 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119" returned: 0 in 0.525s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:21 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.352s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Deleted volume successfully. Aug 28 20:13:21 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119 Aug 28 20:13:21 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a956a04e-5bba-41fa-a13a-86e1d631c09b tempest-VolumesTestJSON-2071062678 None] Lock "cinder-31996de4-c61d-4f05-aca6-aed277eb3fca-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:22 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a89a15c6-02a7-4421-9390-add37e41c119" returned: 0 in 0.258s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Lock "cinder-quobyte-a89a15c6-02a7-4421-9390-add37e41c119" released by "delete_volume" :: held 0.836s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:22 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8" returned: 0 in 0.437s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:22 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8 Aug 28 20:13:22 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Created reservations ['632ae749-acab-453b-be44-eaabc2d2de93', '91efa541-4875-47f1-8ff4-da64834fa317', '8218cba9-3523-4ea2-95c6-b33bd72946ea', '8e505621-3424-4a80-aae9-87ba7697eb09'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:22 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:22 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:22 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f88a856-546d-438f-8f58-c006e69fb5d8" returned: 0 in 0.267s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Lock "cinder-quobyte-9f88a856-546d-438f-8f58-c006e69fb5d8" released by "delete_volume" :: held 0.749s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Created reservations ['7771b753-2311-4600-a63d-eb588a728a30', '40f76a2b-ce44-4e4a-8336-abdeea936d61', '23b3221a-0251-433f-938b-59df994d1cf3', '69bb86b7-b16c-4bbd-9586-fe54a79a835f'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:22 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.279s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Deleted volume successfully. Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:22 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:22 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c553bebd-a954-48c6-9409-92493809cd82 tempest-AbsoluteLimitsTests-752491645 None] Lock "cinder-a89a15c6-02a7-4421-9390-add37e41c119-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:22 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.269s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Deleted volume successfully. Aug 28 20:13:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cffa6015-66d5-46f1-b3f2-acb692142e97 tempest-VolumesTestJSON-2071062678 None] Lock "cinder-9f88a856-546d-438f-8f58-c006e69fb5d8-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c108b7b-ac9f-4ebb-bcc1-48e0befcd8f9 tempest-BackendsCapabilitiesAdminTestsJSON-47684086 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.56498336792, 'free_capacity_gb': 1774.56498336792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86028) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 20:13:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-984f54fe-3d78-490f-a62e-98fbb28e9bf5 tempest-BackendsCapabilitiesAdminTestsJSON-47684086 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.56498336792, 'free_capacity_gb': 1774.56498336792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86028) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Flow 'volume_create_manager' (a6be4653-2a9d-4a42-bf39-c92cd33a7360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d239a7-8353-4e14-96a3-c74b2088d366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Acquiring lock "cinder-29d88edd-df62-44f2-8197-305e598f397c-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d239a7-8353-4e14-96a3-c74b2088d366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1415306479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129b41e5-ab4c-41b6-9241-96cdcdd675ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0398e8460de84f3a94d540a276826918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:30Z,use_quota=True,user_id='ee3c15a1ba834905807f94ec19a725e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1256c401-2eec-4204-abe6-0dc45c817bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1256c401-2eec-4204-abe6-0dc45c817bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c82cac4-b1ca-47b0-aa6a-23d1960c4c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c82cac4-b1ca-47b0-aa6a-23d1960c4c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '129b41e5-ab4c-41b6-9241-96cdcdd675ca', 'volume_name': 'volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53ab21e-041a-4399-a0af-c9414e1d1151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53ab21e-041a-4399-a0af-c9414e1d1151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50369b07-cb77-44c2-94dd-38f30d35d3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:29 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Volume 129b41e5-ab4c-41b6-9241-96cdcdd675ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca', 'volume_size': 1} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1415306479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129b41e5-ab4c-41b6-9241-96cdcdd675ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0398e8460de84f3a94d540a276826918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:30Z,use_quota=True,user_id='ee3c15a1ba834905807f94ec19a725e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Creating volume 129b41e5-ab4c-41b6-9241-96cdcdd675ca {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:13:29 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Lock "cinder-29d88edd-df62-44f2-8197-305e598f397c-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:29 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca 1073741824 Aug 28 20:13:29 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Acquiring lock "cinder-quobyte-29d88edd-df62-44f2-8197-305e598f397c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Lock "cinder-quobyte-29d88edd-df62-44f2-8197-305e598f397c" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[da07e64d-8bc5-4f76-9fb1-cfd72e3c9057]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:30 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c Aug 28 20:13:30 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:30 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca 1073741824" returned: 0 in 0.502s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:30 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca Aug 28 20:13:30 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:30 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c" returned: 0 in 0.492s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:30 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c Aug 28 20:13:30 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:30 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca" returned: 0 in 0.280s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50369b07-cb77-44c2-94dd-38f30d35d3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c2b4c4-c297-4f79-ad0d-b5e4b48f93af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Volume volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca (129b41e5-ab4c-41b6-9241-96cdcdd675ca): created successfully Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c2b4c4-c297-4f79-ad0d-b5e4b48f93af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Flow 'volume_create_manager' (a6be4653-2a9d-4a42-bf39-c92cd33a7360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:30 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4a553674-8387-4394-ab50-65a4f9259eb6 tempest-VolumesTransfersV355Test-1799115761 None] Created volume successfully. Aug 28 20:13:30 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29d88edd-df62-44f2-8197-305e598f397c" returned: 0 in 0.290s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Lock "cinder-quobyte-29d88edd-df62-44f2-8197-305e598f397c" released by "delete_volume" :: held 0.838s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Created reservations ['c208af0d-5df6-4c6d-9753-890bab171dec', '402d1990-f4bb-474c-a0fe-6e8847078fda', 'e5678f79-5253-449f-bb1a-9787f938a3b0', '14705929-01e1-4fea-b8e1-239a258f914f'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:30 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:30 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:31 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.269s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:31 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:31 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Deleted volume successfully. Aug 28 20:13:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-06c8e46d-c0ec-4de2-b579-51eae567a3af tempest-AttachVolumeShelveTestJSON-1274525735 None] Lock "cinder-29d88edd-df62-44f2-8197-305e598f397c-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c6973dda-1443-4506-8cda-0ae921dc119b tempest-VolumesTransfersV355Test-2013441870 None] Transfer volume completed successfully. Aug 28 20:13:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-15420faa-a1f3-45de-9b42-cdbe9d93b87d tempest-GroupSnapshotsV319Test-1111107382 None] Group tempest-GroupSnapshotsV319Test-Group-1398756522: creating Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Acquiring lock "cinder-129b41e5-ab4c-41b6-9241-96cdcdd675ca-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Flow 'volume_create_manager' (4c81c3ad-926b-4270-91a7-fd5bfaa9f74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2543b24d-52e7-4745-8c4c-5a412919f30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Lock "cinder-129b41e5-ab4c-41b6-9241-96cdcdd675ca-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2543b24d-52e7-4745-8c4c-5a412919f30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-70075052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ffa8177-e581-47b5-adae-e130df91deee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bedc2800c5b4bb58c5158f75245bc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:33Z,use_quota=True,user_id='2da437f1bb894bd49083cebf7037e46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caff768c-c95a-4360-afd8-b88c32b022b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caff768c-c95a-4360-afd8-b88c32b022b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7eaf4c-a4ae-4d34-91cf-be5d9f95c9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7eaf4c-a4ae-4d34-91cf-be5d9f95c9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ffa8177-e581-47b5-adae-e130df91deee', 'volume_name': 'volume-8ffa8177-e581-47b5-adae-e130df91deee', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a78dfe8-a7eb-4064-a483-912b6b718d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a78dfe8-a7eb-4064-a483-912b6b718d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba77fdfe-1f21-4a65-96cb-d1f4671d149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:33 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Volume 8ffa8177-e581-47b5-adae-e130df91deee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ffa8177-e581-47b5-adae-e130df91deee', 'volume_size': 1} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-70075052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ffa8177-e581-47b5-adae-e130df91deee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bedc2800c5b4bb58c5158f75245bc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:33Z,use_quota=True,user_id='2da437f1bb894bd49083cebf7037e46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Creating volume 8ffa8177-e581-47b5-adae-e130df91deee {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:13:33 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-15420faa-a1f3-45de-9b42-cdbe9d93b87d tempest-GroupSnapshotsV319Test-1111107382 None] Group tempest-GroupSnapshotsV319Test-Group-1398756522: created successfully Aug 28 20:13:33 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee 1073741824 Aug 28 20:13:33 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-15420faa-a1f3-45de-9b42-cdbe9d93b87d tempest-GroupSnapshotsV319Test-1111107382 None] Create group completed successfully. Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Acquiring lock "cinder-quobyte-129b41e5-ab4c-41b6-9241-96cdcdd675ca" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Lock "cinder-quobyte-129b41e5-ab4c-41b6-9241-96cdcdd675ca" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[96507e94-51be-46da-9bcd-68fa7dd5e63b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:33 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca Aug 28 20:13:33 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:34 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee 1073741824" returned: 0 in 0.506s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:34 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee Aug 28 20:13:34 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:34 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca" returned: 0 in 0.547s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:34 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca Aug 28 20:13:34 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:34 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee" returned: 0 in 0.330s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba77fdfe-1f21-4a65-96cb-d1f4671d149f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ffa8177-e581-47b5-adae-e130df91deee', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2b4628-717e-474d-bad7-9ecdd4a36659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:34 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Volume volume-8ffa8177-e581-47b5-adae-e130df91deee (8ffa8177-e581-47b5-adae-e130df91deee): created successfully Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2b4628-717e-474d-bad7-9ecdd4a36659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Flow 'volume_create_manager' (4c81c3ad-926b-4270-91a7-fd5bfaa9f74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:34 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b8ad3101-0c47-4a0e-aa2c-0b36cff7ceb8 tempest-ServerActionsTestOtherA-233550491 None] Created volume successfully. Aug 28 20:13:34 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-129b41e5-ab4c-41b6-9241-96cdcdd675ca" returned: 0 in 0.437s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Lock "cinder-quobyte-129b41e5-ab4c-41b6-9241-96cdcdd675ca" released by "delete_volume" :: held 1.044s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Created reservations ['060433ab-b82a-4f75-901e-38157527a8d9', 'abbdb982-ddf4-46cb-8424-a8913fd57614', '6aeb01ac-08a6-44ba-b2b3-efb030b3f35a', '2562d954-39d4-477d-a4fb-c11a340cc10f'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:34 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:34 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Flow 'volume_create_manager' (652e6378-6d80-4eae-9ef5-3f0cedcde0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebaee35-d152-4d59-87e9-d26ecd4bfc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebaee35-d152-4d59-87e9-d26ecd4bfc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-139358826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea600acb-fc18-437f-aa93-2684a81259b8,host='devstack@QuobyteHD#QuobyteHD',id=6dd4b802-4e32-4bab-a259-82927ce9fcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e088180be615460f854906675ff47d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:35Z,use_quota=True,user_id='28d90da5c38b4983be41398d3c4125cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39d24da8-53de-4257-9b97-aa49dd3bc968),volume_type_id=39d24da8-53de-4257-9b97-aa49dd3bc968)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4434ba15-0f37-4f18-b13d-53c5db51329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4434ba15-0f37-4f18-b13d-53c5db51329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:35 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555dc876-0bc6-488b-b18a-40416cd8f195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555dc876-0bc6-488b-b18a-40416cd8f195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd4b802-4e32-4bab-a259-82927ce9fcf0', 'volume_name': 'volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de43e7d3-5928-4394-b493-fb6f8dbe2e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de43e7d3-5928-4394-b493-fb6f8dbe2e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2797d8e-6375-4291-9194-220591bf59bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:35 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Volume 6dd4b802-4e32-4bab-a259-82927ce9fcf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0', 'volume_size': 1} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea600acb-fc18-437f-aa93-2684a81259b8,created_at=2026-08-28T18:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-139358826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea600acb-fc18-437f-aa93-2684a81259b8,host='devstack@QuobyteHD#QuobyteHD',id=6dd4b802-4e32-4bab-a259-82927ce9fcf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e088180be615460f854906675ff47d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:35Z,use_quota=True,user_id='28d90da5c38b4983be41398d3c4125cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39d24da8-53de-4257-9b97-aa49dd3bc968),volume_type_id=39d24da8-53de-4257-9b97-aa49dd3bc968)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Creating volume 6dd4b802-4e32-4bab-a259-82927ce9fcf0 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:13:35 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.400s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:35 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Deleted volume successfully. Aug 28 20:13:35 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 1073741824 Aug 28 20:13:35 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b074ea71-ff28-495b-b982-b6fec315b88b tempest-VolumesTransfersV355Test-755901322 None] Lock "cinder-129b41e5-ab4c-41b6-9241-96cdcdd675ca-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:35 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 1073741824" returned: 0 in 0.596s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:35 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 Aug 28 20:13:35 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:36 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0" returned: 0 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2797d8e-6375-4291-9194-220591bf59bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dafed72-5c67-4272-9f6d-c43173cb2314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Volume volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 (6dd4b802-4e32-4bab-a259-82927ce9fcf0): created successfully Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dafed72-5c67-4272-9f6d-c43173cb2314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Flow 'volume_create_manager' (652e6378-6d80-4eae-9ef5-3f0cedcde0ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Flow 'volume_create_manager' (32a53e94-8832-4b94-abd1-242747585324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13cacf4-8f31-4869-a0b1-30e1c9ce03da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:36 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-98f27bf6-f0f6-4a27-a24e-a69ff8f76300 tempest-GroupSnapshotsV319Test-1111107382 None] Created volume successfully. Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13cacf4-8f31-4869-a0b1-30e1c9ce03da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1217011317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7efabe-577d-4c65-af80-dfd6a7dd9e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0398e8460de84f3a94d540a276826918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:36Z,use_quota=True,user_id='ee3c15a1ba834905807f94ec19a725e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375d16e5-372f-4559-9b2e-edd794502ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375d16e5-372f-4559-9b2e-edd794502ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbf919c-dd22-49d7-89f6-53a099643644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbf919c-dd22-49d7-89f6-53a099643644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7efabe-577d-4c65-af80-dfd6a7dd9e1d', 'volume_name': 'volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d461df-337a-4062-b7bf-68520368ae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d461df-337a-4062-b7bf-68520368ae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e68129-2da7-4fb8-80af-fc518ddb54f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Volume ae7efabe-577d-4c65-af80-dfd6a7dd9e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d', 'volume_size': 1} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1217011317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7efabe-577d-4c65-af80-dfd6a7dd9e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0398e8460de84f3a94d540a276826918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:36Z,use_quota=True,user_id='ee3c15a1ba834905807f94ec19a725e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Creating volume ae7efabe-577d-4c65-af80-dfd6a7dd9e1d {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:13:36 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:13:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:36 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d 1073741824 Aug 28 20:13:36 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:37 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d 1073741824" returned: 0 in 0.587s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:37 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d Aug 28 20:13:37 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:37 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:13:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e68129-2da7-4fb8-80af-fc518ddb54f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c298e692-d3a9-4f33-9e83-9ce48b9bcc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:37 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Volume volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d (ae7efabe-577d-4c65-af80-dfd6a7dd9e1d): created successfully Aug 28 20:13:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c298e692-d3a9-4f33-9e83-9ce48b9bcc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Flow 'volume_create_manager' (32a53e94-8832-4b94-abd1-242747585324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:37 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-87d90c63-192a-41e0-8e13-168f44476047 tempest-VolumesTransfersV355Test-1799115761 None] Created volume successfully. Aug 28 20:13:37 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] GroupSnapshot d6088e50-f6e8-4f45-99d4-80335c3ab683: creating. Aug 28 20:13:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Group snapshot d6088e50-f6e8-4f45-99d4-80335c3ab683: creating. {{(pid=86028) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 20:13:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Creating offline snapshot 4713dfcf-d371-4290-bfc6-a21e34a12a8c of volume 6dd4b802-4e32-4bab-a259-82927ce9fcf0 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:13:38 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc036245-892d-4a69-b393-b9c3c89e6a1d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:38 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 Aug 28 20:13:38 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:38 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0" returned: 0 in 0.564s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:38 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c 1G Aug 28 20:13:38 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Acquiring lock "cinder-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Lock "cinder-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Acquiring lock "cinder-quobyte-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Lock "cinder-quobyte-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d" acquired by "delete_volume" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4648cfac-57a7-4513-b69c-a1b2a4f6c667]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:39 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c 1G" returned: 0 in 0.686s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:39 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d Aug 28 20:13:39 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:39 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c Aug 28 20:13:39 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:39 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d" returned: 0 in 0.591s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:39 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c" returned: 0 in 0.477s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:39 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:13:39 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d Aug 28 20:13:39 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:39 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c Aug 28 20:13:39 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:40 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c" returned: 0 in 0.363s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:40 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d" returned: 0 in 0.449s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Lock "cinder-quobyte-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d" released by "delete_volume" :: held 1.117s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:40 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.info Aug 28 20:13:40 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Created reservations ['422cb7bf-a8f2-4d15-bee5-9c01be0b764e', 'c9b0218f-b6f6-48b9-99f2-746742b5528b', '89013c03-ad78-45d3-b711-491307dfade0', 'f70fdacf-e5c3-4335-9c55-70c0a7493efd'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:40 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:40 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:40 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.info" returned: 0 in 0.258s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:40 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:40 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.info Aug 28 20:13:40 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:40 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.398s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Deleted volume successfully. Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a25a5e51-51c5-4b21-93df-7eed7fbb6c6b tempest-VolumesTransfersV355Test-755901322 None] Lock "cinder-ae7efabe-577d-4c65-af80-dfd6a7dd9e1d-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:40 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.info" returned: 0 in 0.362s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9ffb3073-b0a0-4be0-b643-f123597223ce tempest-GroupSnapshotsV319Test-1111107382 None] group_snapshot d6088e50-f6e8-4f45-99d4-80335c3ab683: created successfully Aug 28 20:13:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] group_snapshot d6088e50-f6e8-4f45-99d4-80335c3ab683: deleting Aug 28 20:13:42 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] group_snapshot d6088e50-f6e8-4f45-99d4-80335c3ab683: deleting {{(pid=86028) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 20:13:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Acquiring lock "cinder-quobyte-6dd4b802-4e32-4bab-a259-82927ce9fcf0" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Lock "cinder-quobyte-6dd4b802-4e32-4bab-a259-82927ce9fcf0" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Acquiring lock "cinder-quobyte-4713dfcf-d371-4290-bfc6-a21e34a12a8c" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Lock "cinder-quobyte-4713dfcf-d371-4290-bfc6-a21e34a12a8c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Deleting offline snapshot 4713dfcf-d371-4290-bfc6-a21e34a12a8c of volume 6dd4b802-4e32-4bab-a259-82927ce9fcf0 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:13:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] snapshot_file for this snap is: volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:13:42 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cc94d2-be97-4e7a-9bd0-41052fa5fe96]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:42 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c Aug 28 20:13:42 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:42 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c" returned: 0 in 0.841s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:13:43 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cb5589-e5f1-4d38-915e-50af2285664d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:43 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 Aug 28 20:13:43 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:43 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0" returned: 0 in 0.588s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:43 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c Aug 28 20:13:43 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:44 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c" returned: 0 in 0.635s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:44 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c Aug 28 20:13:44 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:44 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0.4713dfcf-d371-4290-bfc6-a21e34a12a8c" returned: 0 in 0.349s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Lock "cinder-quobyte-4713dfcf-d371-4290-bfc6-a21e34a12a8c" released by "_delete_snapshot" :: held 2.596s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Lock "cinder-quobyte-6dd4b802-4e32-4bab-a259-82927ce9fcf0" released by "delete_snapshot" :: held 2.635s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:44 devstack cinder-volume[86028]: WARNING cinder.quota [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-578648944 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-578648944, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:13:44 devstack cinder-volume[86028]: WARNING cinder.quota [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-578648944 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-578648944, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:13:44 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] Created reservations ['5b32bf01-ea5c-4386-aa8c-25c3ba51bcc7', '6052cd7c-81a3-4463-b2ec-0d3ca1ef0377', '8f4fbd25-d176-40fb-9c95-14afe59c1b87', '095e8ea4-eabe-445b-87d3-30758e699d69'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:44 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-913b0741-4004-4a28-88d2-743625ff3ffd tempest-GroupSnapshotsV319Test-1111107382 None] group_snapshot d6088e50-f6e8-4f45-99d4-80335c3ab683: deleted successfully Aug 28 20:13:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Acquiring lock "cinder-quobyte-6dd4b802-4e32-4bab-a259-82927ce9fcf0" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Lock "cinder-quobyte-6dd4b802-4e32-4bab-a259-82927ce9fcf0" acquired by "delete_volume" :: waited 0.033s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:46 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c176f2-399e-4e8a-b10a-6867d813ffe7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:46 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 Aug 28 20:13:46 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:46 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0" returned: 0 in 0.594s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:46 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0 Aug 28 20:13:46 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:47 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6dd4b802-4e32-4bab-a259-82927ce9fcf0" returned: 0 in 0.387s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Lock "cinder-quobyte-6dd4b802-4e32-4bab-a259-82927ce9fcf0" released by "delete_volume" :: held 1.103s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Created reservations ['75432307-9053-4a1b-b30e-c092187ddc39'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:47 devstack cinder-volume[86028]: WARNING cinder.quota [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-578648944 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-578648944, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Created reservations ['30fa59d1-fdf5-4359-90dd-93812977b5f6', 'ae7941dd-562a-49ae-9df4-debc633326d0', '42996be8-4487-458a-91e9-5478a5d34576', 'bde71f7e-9db4-437d-85b2-e20aad77725a'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:47 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:47 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:47 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.327s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:47 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:47 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-aab37cbd-1b7d-4d5c-bece-b823b6fdc306 tempest-GroupSnapshotsV319Test-1111107382 None] Delete group completed successfully. Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Flow 'volume_create_manager' (ea258094-5b5d-4000-aa1e-45fc1ec5ff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beef8101-f535-4c8a-8a50-77e659096588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beef8101-f535-4c8a-8a50-77e659096588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1446799095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f13385c-7d24-447c-a05e-eb600175e588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c237b2c62a4471bb1d7b9fcb377265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:53Z,use_quota=True,user_id='e97f5bbc8e794ba9b578913c7f43aa09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fba93c4-6f69-405c-89c7-155c13c0dd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fba93c4-6f69-405c-89c7-155c13c0dd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d30c33-8557-40d1-bf93-9a6945f22f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d30c33-8557-40d1-bf93-9a6945f22f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f13385c-7d24-447c-a05e-eb600175e588', 'volume_name': 'volume-8f13385c-7d24-447c-a05e-eb600175e588', 'volume_size': 2}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5e79f2-eef4-4f60-a8f4-21241b4b0d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5e79f2-eef4-4f60-a8f4-21241b4b0d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637e999e-a9b5-4a61-89df-0d7ce7249ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:53 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Volume 8f13385c-7d24-447c-a05e-eb600175e588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f13385c-7d24-447c-a05e-eb600175e588', 'volume_size': 2} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1446799095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f13385c-7d24-447c-a05e-eb600175e588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8c237b2c62a4471bb1d7b9fcb377265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:13:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:13:53Z,use_quota=True,user_id='e97f5bbc8e794ba9b578913c7f43aa09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Creating volume 8f13385c-7d24-447c-a05e-eb600175e588 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:13:53 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588 2147483648 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:53 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588 2147483648 Aug 28 20:13:53 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:53 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588 2147483648" returned: 0 in 0.718s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:53 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=88,cinder:UPDATE=112,cinder:INSERT=34,cinder:DELETE=10 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:13:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:54 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588 Aug 28 20:13:54 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:54 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588" returned: 0 in 0.456s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:13:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637e999e-a9b5-4a61-89df-0d7ce7249ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f13385c-7d24-447c-a05e-eb600175e588', 'volume_size': 2}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4dff7bd-f76d-41f1-8dd1-bb35f93f5931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:13:54 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Volume volume-8f13385c-7d24-447c-a05e-eb600175e588 (8f13385c-7d24-447c-a05e-eb600175e588): created successfully Aug 28 20:13:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4dff7bd-f76d-41f1-8dd1-bb35f93f5931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:13:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Flow 'volume_create_manager' (ea258094-5b5d-4000-aa1e-45fc1ec5ff49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:13:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2b3e6b30-9eca-433c-a4d3-c8e2a1a8da29 tempest-VolumesCloneNegativeTest-45621836 None] Created volume successfully. Aug 28 20:13:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Acquiring lock "cinder-8f13385c-7d24-447c-a05e-eb600175e588-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Lock "cinder-8f13385c-7d24-447c-a05e-eb600175e588-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:55 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=94,cinder:INSERT=31,cinder:UPDATE=119,cinder:DELETE=8 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:13:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Acquiring lock "cinder-quobyte-8f13385c-7d24-447c-a05e-eb600175e588" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:13:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Lock "cinder-quobyte-8f13385c-7d24-447c-a05e-eb600175e588" acquired by "delete_volume" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:13:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[585527ea-3528-4684-9bec-8a730e93a150]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:13:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:55 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588 Aug 28 20:13:55 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:56 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588" returned: 0 in 0.523s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:56 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588 Aug 28 20:13:56 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:56 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8f13385c-7d24-447c-a05e-eb600175e588" returned: 0 in 0.377s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Lock "cinder-quobyte-8f13385c-7d24-447c-a05e-eb600175e588" released by "delete_volume" :: held 0.951s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Created reservations ['90cddca3-7996-4a1f-b752-0703531c9e8e', '3da1b477-6739-4b2e-9289-b7297b9fb361', 'b5b0e34a-c40d-4602-ab89-0fb3a44d4006', '199e76ee-6879-49c7-a0d0-4d5997777d27'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:13:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:13:56 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:13:56 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:13:57 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Aug 28 20:13:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.303s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:13:57 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:13:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Deleted volume successfully. Aug 28 20:13:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a1630573-95ef-4634-ad21-f8cea72859b1 tempest-VolumesCloneNegativeTest-45621836 None] Lock "cinder-8f13385c-7d24-447c-a05e-eb600175e588-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:13:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c74eb629-1a0b-441a-86ae-75643f556345 tempest-GroupsV314Test-514585008 None] Group tempest-GroupsV314Test-Group-271915688: creating Aug 28 20:13:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c74eb629-1a0b-441a-86ae-75643f556345 tempest-GroupsV314Test-514585008 None] Group tempest-GroupsV314Test-Group-271915688: created successfully Aug 28 20:13:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c74eb629-1a0b-441a-86ae-75643f556345 tempest-GroupsV314Test-514585008 None] Create group completed successfully. Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Flow 'volume_create_manager' (5e140dd7-0c16-4db2-be43-502f48016d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56dc0c7-f43e-44c1-8965-aa7a15e32626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56dc0c7-f43e-44c1-8965-aa7a15e32626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1265396702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3340665a-1192-4311-8f58-90a1418fd7a6,host='devstack@QuobyteHD#QuobyteHD',id=b03d6064-0879-4f62-85cd-9fac0406c70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e28c553ea24a48833a95f9a64c4f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:01Z,use_quota=True,user_id='0f23d59c95ce49b6a39224876a8379cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05aa72a3-5800-401c-a7d2-75ca1a2170e5),volume_type_id=05aa72a3-5800-401c-a7d2-75ca1a2170e5)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f50651b-50e2-4ec1-b4ac-0c866908833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f50651b-50e2-4ec1-b4ac-0c866908833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09eff824-4f8a-4510-a879-10ff401a670b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09eff824-4f8a-4510-a879-10ff401a670b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03d6064-0879-4f62-85cd-9fac0406c70c', 'volume_name': 'volume-b03d6064-0879-4f62-85cd-9fac0406c70c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6060310c-8042-469e-84af-1af59e888b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6060310c-8042-469e-84af-1af59e888b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7fa881-a212-4c29-8d68-6e1555c02b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:01 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Volume b03d6064-0879-4f62-85cd-9fac0406c70c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03d6064-0879-4f62-85cd-9fac0406c70c', 'volume_size': 1} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3340665a-1192-4311-8f58-90a1418fd7a6,created_at=2026-08-28T18:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1265396702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3340665a-1192-4311-8f58-90a1418fd7a6,host='devstack@QuobyteHD#QuobyteHD',id=b03d6064-0879-4f62-85cd-9fac0406c70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e28c553ea24a48833a95f9a64c4f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:01Z,use_quota=True,user_id='0f23d59c95ce49b6a39224876a8379cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05aa72a3-5800-401c-a7d2-75ca1a2170e5),volume_type_id=05aa72a3-5800-401c-a7d2-75ca1a2170e5)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Creating volume b03d6064-0879-4f62-85cd-9fac0406c70c {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:14:01 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:01 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c 1073741824 Aug 28 20:14:01 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:01 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c 1073741824" returned: 0 in 0.606s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:02 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c Aug 28 20:14:02 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:02 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c" returned: 0 in 0.309s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:14:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7fa881-a212-4c29-8d68-6e1555c02b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03d6064-0879-4f62-85cd-9fac0406c70c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dad3e4e-599d-4cd5-b4f7-435950aabf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:02 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Volume volume-b03d6064-0879-4f62-85cd-9fac0406c70c (b03d6064-0879-4f62-85cd-9fac0406c70c): created successfully Aug 28 20:14:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dad3e4e-599d-4cd5-b4f7-435950aabf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Flow 'volume_create_manager' (5e140dd7-0c16-4db2-be43-502f48016d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9bd6aad2-1383-4d83-bfdc-102dee913fbf tempest-GroupsV314Test-514585008 None] Created volume successfully. Aug 28 20:14:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:03 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Cloning volume b03d6064-0879-4f62-85cd-9fac0406c70c to volume 8258e651-93e2-43a4-9193-f24f6f42da94 Aug 28 20:14:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Creating offline snapshot 1a941662-0992-4974-a2f5-d948e0d5cfae of volume b03d6064-0879-4f62-85cd-9fac0406c70c {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:14:03 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab3902a-9af6-44de-bb3b-d954cfcdcb36]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:03 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c Aug 28 20:14:03 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:04 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c" returned: 0 in 0.586s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:04 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae 1G Aug 28 20:14:04 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:05 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae 1G" returned: 0 in 1.083s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03d6064-0879-4f62-85cd-9fac0406c70c -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:05 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03d6064-0879-4f62-85cd-9fac0406c70c -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae Aug 28 20:14:05 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:05 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03d6064-0879-4f62-85cd-9fac0406c70c -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae" returned: 0 in 0.801s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:05 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:14:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:05 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae Aug 28 20:14:05 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:06 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae" returned: 0 in 0.467s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:06 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.info Aug 28 20:14:06 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:06 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:14:06 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:06 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.info" returned: 0 in 0.524s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:06 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:14:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:07 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.info Aug 28 20:14:07 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:07 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.438s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:14:07 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.info" returned: 0 in 0.373s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Acquiring lock "cinder-quobyte-8258e651-93e2-43a4-9193-f24f6f42da94" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Lock "cinder-quobyte-8258e651-93e2-43a4-9193-f24f6f42da94" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] snapshot: 1a941662-0992-4974-a2f5-d948e0d5cfae, volume: 8258e651-93e2-43a4-9193-f24f6f42da94, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a687aa1b-f921-40d8-a2fc-c23ba4c38062]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:07 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae Aug 28 20:14:07 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:08 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae" returned: 0 in 0.604s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b03d6064-0879-4f62-85cd-9fac0406c70c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:14:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[36db50e7-b8d3-443b-af22-a972119e7b76]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:08 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c Aug 28 20:14:08 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:08 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c" returned: 0 in 0.526s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:14:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:14:08 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:14:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:08 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 Aug 28 20:14:08 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:16 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:14:16 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=18,cinder:SELECT=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:14:16 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94" returned: 0 in 7.891s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:16 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c, size 1024.00 MB, duration 7.89 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:14:16 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Converted 1024.00 MB image at 129.75 MB/s Aug 28 20:14:16 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:14:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:16 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 Aug 28 20:14:16 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:17 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94" returned: 0 in 0.563s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Lock "cinder-quobyte-8258e651-93e2-43a4-9193-f24f6f42da94" released by "_copy_volume_from_snapshot" :: held 9.703s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Acquiring lock "cinder-quobyte-1a941662-0992-4974-a2f5-d948e0d5cfae" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Lock "cinder-quobyte-1a941662-0992-4974-a2f5-d948e0d5cfae" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Deleting offline snapshot 1a941662-0992-4974-a2f5-d948e0d5cfae of volume b03d6064-0879-4f62-85cd-9fac0406c70c {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:14:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] snapshot_file for this snap is: volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:14:17 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c2fb11-4f27-4be6-988b-06a6742baec2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:17 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae Aug 28 20:14:17 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:18 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae" returned: 0 in 0.768s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b03d6064-0879-4f62-85cd-9fac0406c70c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[131b2d61-9b38-4c9a-982f-fd1f58dc9916]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Flow 'volume_create_manager' (afc86b03-1fd3-4d97-a83e-d7041a48bfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0760f868-a207-4c8f-954f-0b4fe90ad840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:18 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c Aug 28 20:14:18 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0760f868-a207-4c8f-954f-0b4fe90ad840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-46286317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0830563-b488-4105-8c6e-f6d8e749a443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db813cf3665b43a08200a2f41304f872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:18Z,use_quota=True,user_id='a5e6d276768e459eb826e620e7c491ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cba8280-2704-49b5-bfdd-86b618c5787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cba8280-2704-49b5-bfdd-86b618c5787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0efb9a-0722-4cd4-9cdf-687b17b09ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0efb9a-0722-4cd4-9cdf-687b17b09ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0830563-b488-4105-8c6e-f6d8e749a443', 'volume_name': 'volume-e0830563-b488-4105-8c6e-f6d8e749a443', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7821f8b1-5710-4d53-89d3-840f7ed2665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7821f8b1-5710-4d53-89d3-840f7ed2665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46d4f57-b4af-429b-8dc6-cbcb014285d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:18 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Volume e0830563-b488-4105-8c6e-f6d8e749a443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0830563-b488-4105-8c6e-f6d8e749a443', 'volume_size': 1} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-e0d9a942-bf5d-4aab-8a6e-2d83e90cc570 req-14f9941a-8d47-4a89-85a0-ef953c8b3928 tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:19 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c" returned: 0 in 0.966s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:19 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae Aug 28 20:14:19 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:19 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae" returned: 0 in 0.380s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:19 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae Aug 28 20:14:19 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:19 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c.1a941662-0992-4974-a2f5-d948e0d5cfae" returned: 0 in 0.287s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Lock "cinder-quobyte-1a941662-0992-4974-a2f5-d948e0d5cfae" released by "_delete_snapshot" :: held 2.603s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.561s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.351s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-46286317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0830563-b488-4105-8c6e-f6d8e749a443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db813cf3665b43a08200a2f41304f872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:18Z,use_quota=True,user_id='a5e6d276768e459eb826e620e7c491ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Creating volume e0830563-b488-4105-8c6e-f6d8e749a443 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:14:19 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:14:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:19 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 1073741824 Aug 28 20:14:19 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:19 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-75749d1a-957a-4d0c-90a5-51a549abb9f9 tempest-GroupsV314Test-514585008 None] Create group from source-group-3340665a-1192-4311-8f58-90a1418fd7a6 completed successfully. Aug 28 20:14:20 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 1073741824" returned: 0 in 0.490s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:20 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 Aug 28 20:14:20 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:20 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443" returned: 0 in 0.254s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-e0d9a942-bf5d-4aab-8a6e-2d83e90cc570 req-14f9941a-8d47-4a89-85a0-ef953c8b3928 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.758s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46d4f57-b4af-429b-8dc6-cbcb014285d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0830563-b488-4105-8c6e-f6d8e749a443', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11525f0-3979-4af7-a6a3-c889d3a3e67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-e0d9a942-bf5d-4aab-8a6e-2d83e90cc570 req-14f9941a-8d47-4a89-85a0-ef953c8b3928 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:20 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Volume volume-e0830563-b488-4105-8c6e-f6d8e749a443 (e0830563-b488-4105-8c6e-f6d8e749a443): created successfully Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11525f0-3979-4af7-a6a3-c889d3a3e67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Flow 'volume_create_manager' (afc86b03-1fd3-4d97-a83e-d7041a48bfe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:20 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-035ee7a1-58c3-4acf-97c1-9fe6ecd2baf6 tempest-VolumesSnapshotTestJSON-378924921 None] Created volume successfully. Aug 28 20:14:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-e0d9a942-bf5d-4aab-8a6e-2d83e90cc570 req-14f9941a-8d47-4a89-85a0-ef953c8b3928 tempest-ServerActionsTestOtherA-233550491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-8ffa8177-e581-47b5-adae-e130df91deee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be9f583a-093c-4edc-b70f-55a243a1b213', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:14:20 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-e0d9a942-bf5d-4aab-8a6e-2d83e90cc570 req-14f9941a-8d47-4a89-85a0-ef953c8b3928 tempest-ServerActionsTestOtherA-233550491 None] attachment_update completed successfully. Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Acquiring lock "cinder-quobyte-8258e651-93e2-43a4-9193-f24f6f42da94" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Lock "cinder-quobyte-8258e651-93e2-43a4-9193-f24f6f42da94" acquired by "delete_volume" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a557f3ed-a4f6-4f84-b00f-251de2a77a84]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:21 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 Aug 28 20:14:21 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Creating offline snapshot 2c505b3b-4cc4-4763-a4fe-3e55fff08d8d of volume e0830563-b488-4105-8c6e-f6d8e749a443 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e885e743-4407-482d-b062-289da8a01936]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:21 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94" returned: 0 in 0.383s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:21 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 Aug 28 20:14:21 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:22 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94 Aug 28 20:14:22 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:22 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:22 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8258e651-93e2-43a4-9193-f24f6f42da94" returned: 0 in 0.284s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443" returned: 0 in 0.422s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Lock "cinder-quobyte-8258e651-93e2-43a4-9193-f24f6f42da94" released by "delete_volume" :: held 0.741s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:22 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d 1G Aug 28 20:14:22 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Created reservations ['8daa3af9-99c9-450b-be45-96c639b1be7c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:14:22 devstack cinder-volume[86028]: WARNING cinder.quota [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1769210655 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1769210655, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:14:22 devstack cinder-volume[86028]: WARNING cinder.quota [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1769210655 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1769210655, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Created reservations ['3dedc380-0538-4405-8f52-936d83a50a95', '3f27b2c6-1bc3-4582-a193-4dbea0405470', 'd7582a52-4fc7-426d-b609-d5955c3a1e03', 'ffdf3f0a-4274-4cc0-b46f-a680130efd26'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:22 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:14:22 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:22 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d 1G" returned: 0 in 0.431s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0830563-b488-4105-8c6e-f6d8e749a443 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:22 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0830563-b488-4105-8c6e-f6d8e749a443 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d Aug 28 20:14:22 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:22 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.291s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:22 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:14:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-cc3c70af-eb8a-4acd-961e-aa8cc17cca06 tempest-GroupsV314Test-514585008 None] Delete group completed successfully. Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Acquiring lock "cinder-quobyte-b03d6064-0879-4f62-85cd-9fac0406c70c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Lock "cinder-quobyte-b03d6064-0879-4f62-85cd-9fac0406c70c" acquired by "delete_volume" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:23 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0830563-b488-4105-8c6e-f6d8e749a443 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d" returned: 0 in 0.404s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:23 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d is being set with open permissions: ugo+rw Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a150ac-ebbd-4940-9b38-5e367ced2af5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:23 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d Aug 28 20:14:23 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:23 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c Aug 28 20:14:23 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:23 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d" returned: 0 in 0.349s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:23 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.info Aug 28 20:14:23 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:23 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c" returned: 0 in 0.446s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:23 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c Aug 28 20:14:23 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:23 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.info" returned: 0 in 0.275s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:23 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.info is being set with open permissions: ugo+rw Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:23 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.info Aug 28 20:14:23 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:23 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b03d6064-0879-4f62-85cd-9fac0406c70c" returned: 0 in 0.273s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Lock "cinder-quobyte-b03d6064-0879-4f62-85cd-9fac0406c70c" released by "delete_volume" :: held 0.818s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:23 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Created reservations ['edf16c21-c478-45e2-b61e-80be93cd5016'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Created reservations ['8bb27715-a2b4-4ccd-a877-c27303352d2c', 'b4b3e19a-9f89-49ea-9317-011b8026709c', 'e96ba37d-737d-495a-a622-77d591b6981e', 'b705f811-1d84-44e1-b05a-09976151cbb8'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:14:24 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.info" returned: 0 in 0.275s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-15b4cb5e-fe07-4c1b-8159-e4ab166e0439 tempest-VolumesSnapshotTestJSON-378924921 None] Create snapshot completed successfully Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:24 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:14:24 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-10089f74-e8ea-429c-8315-83994709b989 req-8c2d2a8c-f7db-46fa-bafd-fbad61133108 tempest-ServerActionsTestOtherA-233550491 None] Terminate volume connection completed successfully. Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-10089f74-e8ea-429c-8315-83994709b989 req-8c2d2a8c-f7db-46fa-bafd-fbad61133108 tempest-ServerActionsTestOtherA-233550491 None] Deleting attachment be9f583a-093c-4edc-b70f-55a243a1b213. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:14:24 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.280s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:24 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:14:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4d8b4463-99d9-4466-a534-876ceb13b5a9 tempest-GroupsV314Test-514585008 None] Delete group completed successfully. Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-2c505b3b-4cc4-4763-a4fe-3e55fff08d8d-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-2c505b3b-4cc4-4763-a4fe-3e55fff08d8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-e0830563-b488-4105-8c6e-f6d8e749a443" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-e0830563-b488-4105-8c6e-f6d8e749a443" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-2c505b3b-4cc4-4763-a4fe-3e55fff08d8d" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-2c505b3b-4cc4-4763-a4fe-3e55fff08d8d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Deleting offline snapshot 2c505b3b-4cc4-4763-a4fe-3e55fff08d8d of volume e0830563-b488-4105-8c6e-f6d8e749a443 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] snapshot_file for this snap is: volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-10089f74-e8ea-429c-8315-83994709b989 req-c4b4c060-362b-430a-af5c-3ae26477f2d0 tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-10089f74-e8ea-429c-8315-83994709b989 req-c4b4c060-362b-430a-af5c-3ae26477f2d0 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e9010d-31ea-4e60-aff7-75c582bc1258]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-10089f74-e8ea-429c-8315-83994709b989 req-c4b4c060-362b-430a-af5c-3ae26477f2d0 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-10089f74-e8ea-429c-8315-83994709b989 req-c4b4c060-362b-430a-af5c-3ae26477f2d0 tempest-ServerActionsTestOtherA-233550491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-8ffa8177-e581-47b5-adae-e130df91deee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1de4573-ee42-464d-9b08-bc066a3ce8ef', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:14:25 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-10089f74-e8ea-429c-8315-83994709b989 req-c4b4c060-362b-430a-af5c-3ae26477f2d0 tempest-ServerActionsTestOtherA-233550491 None] attachment_update completed successfully. Aug 28 20:14:25 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d Aug 28 20:14:25 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:25 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d" returned: 0 in 0.477s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0830563-b488-4105-8c6e-f6d8e749a443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0275c579-d3d3-4957-990e-1096587a3e53]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:25 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 Aug 28 20:14:25 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:26 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443" returned: 0 in 0.494s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:26 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d Aug 28 20:14:26 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:26 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d" returned: 0 in 0.485s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:26 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d Aug 28 20:14:26 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:27 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443.2c505b3b-4cc4-4763-a4fe-3e55fff08d8d" returned: 0 in 0.653s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-2c505b3b-4cc4-4763-a4fe-3e55fff08d8d" released by "_delete_snapshot" :: held 2.294s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-e0830563-b488-4105-8c6e-f6d8e749a443" released by "delete_snapshot" :: held 2.327s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:27 devstack cinder-volume[86028]: WARNING cinder.quota [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:14:27 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Created reservations ['6c882209-daac-44cf-9cf7-c0546588ee3c', '2023870c-477d-4ad4-a1fc-412cb421eaaf', '1eb3db08-b5c1-4258-befb-0e73eb7beab1', '3163d1e4-6add-404b-9217-7540ec4f0458'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:14:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Delete snapshot completed successfully. Aug 28 20:14:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9b53c97-23ab-4c78-b353-5d14c7180e00 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-2c505b3b-4cc4-4763-a4fe-3e55fff08d8d-delete_snapshot" released by "delete_snapshot" :: held 2.716s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Flow 'volume_create_manager' (aabde0ff-0397-41cf-a9a7-19c4dc41ccae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f22e23-5f28-4c38-8632-5fce9ae2d7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f22e23-5f28-4c38-8632-5fce9ae2d7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2143599111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bd3c0a-f7e0-40ac-ac57-0137f44ee355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db813cf3665b43a08200a2f41304f872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:29Z,use_quota=True,user_id='a5e6d276768e459eb826e620e7c491ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2622a765-5b51-4752-9d75-e51a38bcef04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2622a765-5b51-4752-9d75-e51a38bcef04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4f0c21-920d-4fac-937b-9b39b8de7fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4f0c21-920d-4fac-937b-9b39b8de7fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74bd3c0a-f7e0-40ac-ac57-0137f44ee355', 'volume_name': 'volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8def68b8-e7a1-4acb-ac43-fc875674cbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8def68b8-e7a1-4acb-ac43-fc875674cbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4acc37b-ba83-4cc2-a1f5-6d745de392a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:29 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Volume 74bd3c0a-f7e0-40ac-ac57-0137f44ee355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355', 'volume_size': 1} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2143599111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bd3c0a-f7e0-40ac-ac57-0137f44ee355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db813cf3665b43a08200a2f41304f872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:29Z,use_quota=True,user_id='a5e6d276768e459eb826e620e7c491ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Creating volume 74bd3c0a-f7e0-40ac-ac57-0137f44ee355 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:14:29 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:14:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:29 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 1073741824 Aug 28 20:14:29 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:30 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 1073741824" returned: 0 in 0.766s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Flow 'volume_create_manager' (75b71dd4-1cca-46a8-82dc-2c51b35237af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad9c56a-21db-40d5-806d-6f5400376113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad9c56a-21db-40d5-806d-6f5400376113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1216609323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d470b697-94cd-4d2b-a3e5-cdfa5ab39dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30410eb447684863a44367cac68fd879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:30Z,use_quota=True,user_id='8099f1f37b1a4058866c3b1a2843d4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d09fd7-2c89-4fa3-b327-9b1371bd3e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d09fd7-2c89-4fa3-b327-9b1371bd3e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd9ab38-bf14-465f-969e-3429da08a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd9ab38-bf14-465f-969e-3429da08a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd470b697-94cd-4d2b-a3e5-cdfa5ab39dea', 'volume_name': 'volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253ba3a2-9630-45d8-be85-98723d3302fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253ba3a2-9630-45d8-be85-98723d3302fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6e72c9-6b61-4e15-b728-809fd919657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Volume d470b697-94cd-4d2b-a3e5-cdfa5ab39dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea', 'volume_size': 1} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:30 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 Aug 28 20:14:30 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:30 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" returned: 0 in 0.266s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1216609323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d470b697-94cd-4d2b-a3e5-cdfa5ab39dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30410eb447684863a44367cac68fd879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:30Z,use_quota=True,user_id='8099f1f37b1a4058866c3b1a2843d4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Creating volume d470b697-94cd-4d2b-a3e5-cdfa5ab39dea {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:14:30 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4acc37b-ba83-4cc2-a1f5-6d745de392a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:30 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea 1073741824 Aug 28 20:14:30 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b4d128-d6d4-48a1-bafd-2c819bde7fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Volume volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 (74bd3c0a-f7e0-40ac-ac57-0137f44ee355): created successfully Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b4d128-d6d4-48a1-bafd-2c819bde7fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Flow 'volume_create_manager' (aabde0ff-0397-41cf-a9a7-19c4dc41ccae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:30 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e64c1a4d-5e76-4ea4-a9d6-414e181e6670 tempest-VolumesSnapshotTestJSON-378924921 None] Created volume successfully. Aug 28 20:14:31 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea 1073741824" returned: 0 in 0.644s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:31 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea Aug 28 20:14:31 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:31 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea" returned: 0 in 0.333s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.042s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6e72c9-6b61-4e15-b728-809fd919657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb5efd5-4e9a-4aea-8cba-fb62b3ec2088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Creating offline snapshot 06a11076-3b63-4927-9433-b14782f1c227 of volume 74bd3c0a-f7e0-40ac-ac57-0137f44ee355 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:14:31 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Volume volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea (d470b697-94cd-4d2b-a3e5-cdfa5ab39dea): created successfully Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb5efd5-4e9a-4aea-8cba-fb62b3ec2088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Flow 'volume_create_manager' (75b71dd4-1cca-46a8-82dc-2c51b35237af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf8197-ca52-4788-9a1f-ae2ecfac8bec]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:31 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f6e5a20d-a6d8-4146-a01c-7c1a80b1dd6a tempest-GroupsV320Test-117662461 None] Group tempest-GroupsV320Test-Group-1064459290: creating Aug 28 20:14:31 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0931f576-409f-4b86-9ccf-aaa1793211e2 tempest-AttachVolumeTestJSON-717553024 None] Created volume successfully. Aug 28 20:14:31 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f6e5a20d-a6d8-4146-a01c-7c1a80b1dd6a tempest-GroupsV320Test-117662461 None] Group tempest-GroupsV320Test-Group-1064459290: created successfully Aug 28 20:14:31 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f6e5a20d-a6d8-4146-a01c-7c1a80b1dd6a tempest-GroupsV320Test-117662461 None] Create group completed successfully. Aug 28 20:14:31 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 Aug 28 20:14:31 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:32 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" returned: 0 in 0.411s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:32 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 1G Aug 28 20:14:32 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:32 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 1G" returned: 0 in 0.493s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:32 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 Aug 28 20:14:32 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:33 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227" returned: 0 in 0.432s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:33 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 is being set with open permissions: ugo+rw Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fca8739e-c625-47c9-9430-82cfa3851e87 req-5ceab908-5f89-489e-9e45-7e896783f7d7 tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:33 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 Aug 28 20:14:33 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:33 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227" returned: 0 in 0.272s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-6c4e5e0e-c4e0-4daa-bbff-5072659e398b tempest-GroupsV320Test-117662461 None] Created reservations ['d19d7694-0958-4728-866d-10190407a89b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:14:33 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.info Aug 28 20:14:33 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6c4e5e0e-c4e0-4daa-bbff-5072659e398b tempest-GroupsV320Test-117662461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6c4e5e0e-c4e0-4daa-bbff-5072659e398b tempest-GroupsV320Test-117662461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e5e0e-c4e0-4daa-bbff-5072659e398b tempest-GroupsV320Test-117662461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6c4e5e0e-c4e0-4daa-bbff-5072659e398b tempest-GroupsV320Test-117662461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6c4e5e0e-c4e0-4daa-bbff-5072659e398b tempest-GroupsV320Test-117662461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c4e5e0e-c4e0-4daa-bbff-5072659e398b tempest-GroupsV320Test-117662461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:33 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:14:33 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:33 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.info" returned: 0 in 0.289s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:33 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.info is being set with open permissions: ugo+rw Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:33 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.info Aug 28 20:14:33 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:33 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c4e5e0e-c4e0-4daa-bbff-5072659e398b tempest-GroupsV320Test-117662461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.302s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-6c4e5e0e-c4e0-4daa-bbff-5072659e398b tempest-GroupsV320Test-117662461 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:14:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6c4e5e0e-c4e0-4daa-bbff-5072659e398b tempest-GroupsV320Test-117662461 None] Delete group completed successfully. Aug 28 20:14:33 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.info" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fca8739e-c625-47c9-9430-82cfa3851e87 req-5ceab908-5f89-489e-9e45-7e896783f7d7 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.858s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fca8739e-c625-47c9-9430-82cfa3851e87 req-5ceab908-5f89-489e-9e45-7e896783f7d7 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0075d46c-c51f-49ac-b673-7c2114f86078 tempest-VolumesSnapshotTestJSON-378924921 None] Create snapshot completed successfully Aug 28 20:14:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fca8739e-c625-47c9-9430-82cfa3851e87 req-5ceab908-5f89-489e-9e45-7e896783f7d7 tempest-AttachVolumeTestJSON-717553024 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a46367d0-d720-42c2-94f6-5c3a5c7fed57', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:14:34 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-fca8739e-c625-47c9-9430-82cfa3851e87 req-5ceab908-5f89-489e-9e45-7e896783f7d7 tempest-AttachVolumeTestJSON-717553024 None] attachment_update completed successfully. Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Flow 'volume_create_manager' (15b41cd2-5bc1-4365-a4b7-fd3d89398db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d0ebc2-aaf1-42d0-9f30-24bf70fd8448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d0ebc2-aaf1-42d0-9f30-24bf70fd8448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-823185639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb0477c-5431-4c47-aa0c-8a28a7f345e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db813cf3665b43a08200a2f41304f872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=06a11076-3b63-4927-9433-b14782f1c227,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:35Z,use_quota=True,user_id='a5e6d276768e459eb826e620e7c491ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350cf376-c4ec-4280-a641-a355e2e7b8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350cf376-c4ec-4280-a641-a355e2e7b8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c626f3b-9f91-4eae-b112-492d6e1591d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c626f3b-9f91-4eae-b112-492d6e1591d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6fb0477c-5431-4c47-aa0c-8a28a7f345e0', 'volume_name': 'volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0', 'volume_size': 2, 'snapshot_id': '06a11076-3b63-4927-9433-b14782f1c227'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10ca714-e0e0-4a48-a91d-cba9eb5ff89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10ca714-e0e0-4a48-a91d-cba9eb5ff89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85326ba-9dc7-40d1-8d6b-1d4f77021c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:35 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Volume 6fb0477c-5431-4c47-aa0c-8a28a7f345e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0', 'volume_size': 2, 'snapshot_id': '06a11076-3b63-4927-9433-b14782f1c227'} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-06a11076-3b63-4927-9433-b14782f1c227-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" by "_create_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-06a11076-3b63-4927-9433-b14782f1c227-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Creating volume 6fb0477c-5431-4c47-aa0c-8a28a7f345e0 from snapshot 06a11076-3b63-4927-9433-b14782f1c227 {{(pid=86028) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] snapshot: 06a11076-3b63-4927-9433-b14782f1c227, volume: 6fb0477c-5431-4c47-aa0c-8a28a7f345e0, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f235801-6591-415a-9e60-d11f8f86a189]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:36 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 Aug 28 20:14:36 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:36 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227" returned: 0 in 0.450s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:14:36 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f07786a-e889-4315-965d-6c375ce10c74]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:36 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 Aug 28 20:14:36 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:36 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" returned: 0 in 0.412s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:14:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:14:36 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:14:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:36 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 Aug 28 20:14:36 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:45 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" returned: 0 in 8.576s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:14:45 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Converted 1024.00 MB image at 119.37 MB/s Aug 28 20:14:45 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 is being set with open permissions: ugo+rw Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:45 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 Aug 28 20:14:45 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:45 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" released by "_copy_volume_from_snapshot" :: held 9.857s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-06a11076-3b63-4927-9433-b14782f1c227-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" released by "_create_volume_from_snapshot" :: held 9.968s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.995s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85326ba-9dc7-40d1-8d6b-1d4f77021c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0', 'volume_size': 2, 'snapshot_id': '06a11076-3b63-4927-9433-b14782f1c227'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808a2bf1-f551-4348-be4c-bdd5ace23170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:45 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Volume volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 (6fb0477c-5431-4c47-aa0c-8a28a7f345e0): created successfully Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808a2bf1-f551-4348-be4c-bdd5ace23170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Flow 'volume_create_manager' (15b41cd2-5bc1-4365-a4b7-fd3d89398db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-bf5a3583-ba7f-41bc-89a5-2764dd5f3fa9 tempest-VolumesSnapshotTestJSON-378924921 None] Created volume successfully. Aug 28 20:14:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-6fb0477c-5431-4c47-aa0c-8a28a7f345e0-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-6fb0477c-5431-4c47-aa0c-8a28a7f345e0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:46 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3825071-afe9-4cf0-89bf-22a289d9ff92]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:46 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 Aug 28 20:14:46 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:46 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" returned: 0 in 0.431s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:46 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0 Aug 28 20:14:46 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:47 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" returned: 0 in 0.317s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-6fb0477c-5431-4c47-aa0c-8a28a7f345e0" released by "delete_volume" :: held 0.797s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Created reservations ['b474d531-2348-4887-8b26-ba3a19703f49', 'baccbe93-39ad-44bb-9599-4c553cf73cd5', 'e85f2551-bc11-4aaa-9bea-7e8bb699d0b5', '1a032172-67bb-4830-b48f-916d6c3a53d9'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:47 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:14:47 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-06a11076-3b63-4927-9433-b14782f1c227-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-06a11076-3b63-4927-9433-b14782f1c227-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-06a11076-3b63-4927-9433-b14782f1c227" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-06a11076-3b63-4927-9433-b14782f1c227" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Deleting offline snapshot 06a11076-3b63-4927-9433-b14782f1c227 of volume 74bd3c0a-f7e0-40ac-ac57-0137f44ee355 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] snapshot_file for this snap is: volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fffa71-dd80-49cd-bb94-29c7549fb477]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:47 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:47 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.427s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:47 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:14:47 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Deleted volume successfully. Aug 28 20:14:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-07867fd9-c3d3-4a01-bb0e-3a1d775b0afe tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-6fb0477c-5431-4c47-aa0c-8a28a7f345e0-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:48 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227" returned: 0 in 0.405s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:14:48 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eaa380-0336-4ae7-80a4-6d5ec9b6a545]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:48 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 Aug 28 20:14:48 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:48 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" returned: 0 in 0.598s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:48 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 Aug 28 20:14:48 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:49 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227" returned: 0 in 0.347s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:49 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227 Aug 28 20:14:49 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:49 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355.06a11076-3b63-4927-9433-b14782f1c227" returned: 0 in 0.293s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-06a11076-3b63-4927-9433-b14782f1c227" released by "_delete_snapshot" :: held 1.780s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" released by "delete_snapshot" :: held 1.816s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Created reservations ['94bacf79-47a6-4da5-9b23-b84e79725b6f', 'a9d9b63d-2be1-43cc-b4af-5a7556f11406', '7b6724d9-0bf3-4655-bf97-9fbafa968bf7', '282bd939-18d1-40e3-9b4b-53a33dd08dc9'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:14:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Delete snapshot completed successfully. Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bf5ab8c5-38f7-4c5a-834a-468ea52e6f94 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-06a11076-3b63-4927-9433-b14782f1c227-delete_snapshot" released by "delete_snapshot" :: held 1.983s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-74bd3c0a-f7e0-40ac-ac57-0137f44ee355-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-74bd3c0a-f7e0-40ac-ac57-0137f44ee355-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd421c56-c49f-404b-9cc8-c6b68522f526]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:50 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 Aug 28 20:14:50 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:50 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" returned: 0 in 0.543s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:50 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355 Aug 28 20:14:50 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:50 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" returned: 0 in 0.324s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-74bd3c0a-f7e0-40ac-ac57-0137f44ee355" released by "delete_volume" :: held 0.937s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:50 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Created reservations ['65ecf4ee-7d1d-41cd-b35b-646e2c35c5ff', '7edcab0c-ee05-42d5-987d-dbd73913f22a', '41801792-79b1-4459-8dc6-326bd1dd00c6', '0cb0245a-44c3-4a5c-b669-c3be60cb575e'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:14:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:51 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:14:51 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:51 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.342s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:14:51 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Deleted volume successfully. Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-357ae591-f95b-4ff3-a4cf-70f6ba7b8fc9 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-74bd3c0a-f7e0-40ac-ac57-0137f44ee355-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Flow 'volume_create_manager' (c3d21910-cf6e-41b7-9eca-2b4cb990831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8d2651-3782-4f64-b86a-bef1f80a9df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8d2651-3782-4f64-b86a-bef1f80a9df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-3047912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b841f4-2565-4afa-9aae-9adfaea4af35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db813cf3665b43a08200a2f41304f872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:52Z,use_quota=True,user_id='a5e6d276768e459eb826e620e7c491ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc633f3-bfb9-4283-a72a-65b79eb56c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc633f3-bfb9-4283-a72a-65b79eb56c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2019f29-1e40-49e8-b646-2d6d3e03d31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2019f29-1e40-49e8-b646-2d6d3e03d31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b841f4-2565-4afa-9aae-9adfaea4af35', 'volume_name': 'volume-38b841f4-2565-4afa-9aae-9adfaea4af35', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc06e587-4c22-4e38-86cf-9ab1092687bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc06e587-4c22-4e38-86cf-9ab1092687bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a388ddc8-c90f-4bd2-91da-7bcd70d4d50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:51 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Volume 38b841f4-2565-4afa-9aae-9adfaea4af35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b841f4-2565-4afa-9aae-9adfaea4af35', 'volume_size': 1} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-3047912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b841f4-2565-4afa-9aae-9adfaea4af35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db813cf3665b43a08200a2f41304f872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:52Z,use_quota=True,user_id='a5e6d276768e459eb826e620e7c491ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Creating volume 38b841f4-2565-4afa-9aae-9adfaea4af35 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:14:51 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:14:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:51 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 1073741824 Aug 28 20:14:51 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:52 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 1073741824" returned: 0 in 0.519s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:52 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 Aug 28 20:14:52 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:52 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:14:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a388ddc8-c90f-4bd2-91da-7bcd70d4d50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b841f4-2565-4afa-9aae-9adfaea4af35', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d8c91a-3ff1-4c02-be4b-5b81c8e7447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Volume volume-38b841f4-2565-4afa-9aae-9adfaea4af35 (38b841f4-2565-4afa-9aae-9adfaea4af35): created successfully Aug 28 20:14:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d8c91a-3ff1-4c02-be4b-5b81c8e7447b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Flow 'volume_create_manager' (c3d21910-cf6e-41b7-9eca-2b4cb990831c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-decae5f4-3cd0-4281-867d-f31ff7c3f976 tempest-VolumesSnapshotTestJSON-378924921 None] Created volume successfully. Aug 28 20:14:53 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Flow 'volume_create_manager' (59d70ec3-b647-4ccb-a773-57635f6d2988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2c3ec2-0db6-4393-a1e2-084c33903342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2c3ec2-0db6-4393-a1e2-084c33903342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1412613469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96639b1a-170b-4808-8540-e8c627d39fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730d577260534ae2bd05fa0c6d8b905c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:54Z,use_quota=True,user_id='b3d4c1190e2f4963aea9fa7acf08ff12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba280af3-86f9-497e-91ae-0ee22cb538a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba280af3-86f9-497e-91ae-0ee22cb538a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91187d91-9987-48ef-9015-43b3733b91f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91187d91-9987-48ef-9015-43b3733b91f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96639b1a-170b-4808-8540-e8c627d39fb0', 'volume_name': 'volume-96639b1a-170b-4808-8540-e8c627d39fb0', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64909b30-699b-4e3f-857b-18373a1fe47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64909b30-699b-4e3f-857b-18373a1fe47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9618ef-e997-49ae-a952-2f206b6faf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:54 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Volume 96639b1a-170b-4808-8540-e8c627d39fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96639b1a-170b-4808-8540-e8c627d39fb0', 'volume_size': 1} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1412613469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96639b1a-170b-4808-8540-e8c627d39fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730d577260534ae2bd05fa0c6d8b905c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:54Z,use_quota=True,user_id='b3d4c1190e2f4963aea9fa7acf08ff12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Creating volume 96639b1a-170b-4808-8540-e8c627d39fb0 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:14:54 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:54 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0 1073741824 Aug 28 20:14:54 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:54 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0 1073741824" returned: 0 in 0.524s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:54 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0 Aug 28 20:14:54 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-25e62159-61e9-4a52-a061-512f18f99b7b req-d2ed1d30-b423-406a-a16a-c5eef4e32708 tempest-ServerActionsTestOtherA-233550491 None] Terminate volume connection completed successfully. Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-25e62159-61e9-4a52-a061-512f18f99b7b req-d2ed1d30-b423-406a-a16a-c5eef4e32708 tempest-ServerActionsTestOtherA-233550491 None] Deleting attachment f1de4573-ee42-464d-9b08-bc066a3ce8ef. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:14:54 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0" returned: 0 in 0.288s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.684s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9618ef-e997-49ae-a952-2f206b6faf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96639b1a-170b-4808-8540-e8c627d39fb0', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7296ba-db77-401c-9888-6746fcc6fd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Creating offline snapshot 412a64d7-0327-49bb-8804-7a7295e378a7 of volume 38b841f4-2565-4afa-9aae-9adfaea4af35 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:14:55 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Volume volume-96639b1a-170b-4808-8540-e8c627d39fb0 (96639b1a-170b-4808-8540-e8c627d39fb0): created successfully Aug 28 20:14:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7296ba-db77-401c-9888-6746fcc6fd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Flow 'volume_create_manager' (59d70ec3-b647-4ccb-a773-57635f6d2988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73a76cb-82d1-4f81-9e1c-e4a14136b97e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9a7395b4-9392-4621-96dd-08a2e3521fbb tempest-VolumesServicesTestJSON-1243586494 None] Created volume successfully. Aug 28 20:14:55 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 Aug 28 20:14:55 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:55 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35" returned: 0 in 0.381s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:55 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 1G Aug 28 20:14:55 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:55 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 1G" returned: 0 in 0.507s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b841f4-2565-4afa-9aae-9adfaea4af35 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:55 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b841f4-2565-4afa-9aae-9adfaea4af35 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 Aug 28 20:14:55 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:56 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b841f4-2565-4afa-9aae-9adfaea4af35 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7" returned: 0 in 0.468s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:56 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 is being set with open permissions: ugo+rw Aug 28 20:14:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:56 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 Aug 28 20:14:56 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Acquiring lock "cinder-96639b1a-170b-4808-8540-e8c627d39fb0-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Lock "cinder-96639b1a-170b-4808-8540-e8c627d39fb0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Acquiring lock "cinder-quobyte-96639b1a-170b-4808-8540-e8c627d39fb0" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Lock "cinder-quobyte-96639b1a-170b-4808-8540-e8c627d39fb0" acquired by "delete_volume" :: waited 0.040s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:56 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[54034236-834d-40f6-a90d-ad9d1efac9dc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:56 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7" returned: 0 in 0.398s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:56 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.info Aug 28 20:14:56 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:56 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0 Aug 28 20:14:56 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:57 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.info" returned: 0 in 0.709s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:57 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.info is being set with open permissions: ugo+rw Aug 28 20:14:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:57 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0" returned: 0 in 0.924s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:57 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.info Aug 28 20:14:57 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:57 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0 Aug 28 20:14:57 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:57 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.info" returned: 0 in 0.347s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.029s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:58 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b582ac5d-4c4c-426b-bc72-35a48fc1a5e4 tempest-VolumesSnapshotTestJSON-378924921 None] Create snapshot completed successfully Aug 28 20:14:58 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-96639b1a-170b-4808-8540-e8c627d39fb0" returned: 0 in 0.429s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Lock "cinder-quobyte-96639b1a-170b-4808-8540-e8c627d39fb0" released by "delete_volume" :: held 1.430s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Created reservations ['1f992b02-e86e-4bba-9989-82b213edbc4c', '6e688e24-1906-4417-a6bc-73a156876def', 'ac1b0105-d018-489d-bca7-7e7dbcfa33c0', '7ffbfa79-f3a7-44fe-84c1-96705676fdde'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:58 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:14:58 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:58 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.296s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:14:58 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Deleted volume successfully. Aug 28 20:14:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18583cd3-87ee-4b96-8afe-3f9948b8f079 tempest-VolumesServicesTestJSON-1243586494 None] Lock "cinder-96639b1a-170b-4808-8540-e8c627d39fb0-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Flow 'volume_create_manager' (59924919-ee82-4a2e-8437-32a04fd3f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea461d5-e556-47cf-9281-c024f5f86114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea461d5-e556-47cf-9281-c024f5f86114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-365903702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0ca944-68b3-4b48-98b4-986d1a46267f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db813cf3665b43a08200a2f41304f872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=412a64d7-0327-49bb-8804-7a7295e378a7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:14:59Z,use_quota=True,user_id='a5e6d276768e459eb826e620e7c491ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e91fd42-6065-46dc-9a6f-b688ffaa264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e91fd42-6065-46dc-9a6f-b688ffaa264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a478f3-7275-45f8-8eca-6a418cc8a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a478f3-7275-45f8-8eca-6a418cc8a909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cc0ca944-68b3-4b48-98b4-986d1a46267f', 'volume_name': 'volume-cc0ca944-68b3-4b48-98b4-986d1a46267f', 'volume_size': 1, 'snapshot_id': '412a64d7-0327-49bb-8804-7a7295e378a7'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381f454a-6a6f-45c3-a0c6-3359e1a4a024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381f454a-6a6f-45c3-a0c6-3359e1a4a024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b5d979-7d11-4215-821f-f6e67126f5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:14:59 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Volume cc0ca944-68b3-4b48-98b4-986d1a46267f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cc0ca944-68b3-4b48-98b4-986d1a46267f', 'volume_size': 1, 'snapshot_id': '412a64d7-0327-49bb-8804-7a7295e378a7'} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-412a64d7-0327-49bb-8804-7a7295e378a7-cc0ca944-68b3-4b48-98b4-986d1a46267f" by "_create_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-412a64d7-0327-49bb-8804-7a7295e378a7-cc0ca944-68b3-4b48-98b4-986d1a46267f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Creating volume cc0ca944-68b3-4b48-98b4-986d1a46267f from snapshot 412a64d7-0327-49bb-8804-7a7295e378a7 {{(pid=86028) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-cc0ca944-68b3-4b48-98b4-986d1a46267f" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-cc0ca944-68b3-4b48-98b4-986d1a46267f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] snapshot: 412a64d7-0327-49bb-8804-7a7295e378a7, volume: cc0ca944-68b3-4b48-98b4-986d1a46267f, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e051de-47ac-4b26-a3e5-d75538135561]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:14:59 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 Aug 28 20:14:59 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:14:59 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7" returned: 0 in 0.417s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38b841f4-2565-4afa-9aae-9adfaea4af35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[2406dd4a-3234-40de-b601-c1645f9abf91]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:14:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:00 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 Aug 28 20:15:00 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:00 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35" returned: 0 in 0.451s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:15:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:15:00 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:15:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:00 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f Aug 28 20:15:00 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:04 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:15:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Flow 'volume_create_manager' (74a432ac-660d-497a-abbc-91d0a06e32ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:15:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9deed429-f40e-4081-8b96-16b7c246af3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9deed429-f40e-4081-8b96-16b7c246af3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-860426982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703e7cfd-d248-4e53-8584-2f650394d6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bedc2800c5b4bb58c5158f75245bc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:15:04Z,use_quota=True,user_id='2da437f1bb894bd49083cebf7037e46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb5a812-95db-4034-b6a3-1aabe06cbe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb5a812-95db-4034-b6a3-1aabe06cbe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c8d956-4e7e-4912-97b1-a2f99cee7e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:04 devstack cinder-volume[86028]: DEBUG cinder.image.glance [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Creating Keystone auth plugin from conf {{(pid=86028) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 20:15:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c8d956-4e7e-4912-97b1-a2f99cee7e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '703e7cfd-d248-4e53-8584-2f650394d6c9', 'volume_name': 'volume-703e7cfd-d248-4e53-8584-2f650394d6c9', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8599d5-1dfd-4164-ab13-c0772e119e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8599d5-1dfd-4164-ab13-c0772e119e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145a9eab-275b-482c-bc9d-2de3cc35b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:05 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Volume 703e7cfd-d248-4e53-8584-2f650394d6c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-703e7cfd-d248-4e53-8584-2f650394d6c9', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 20:15:05 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Trying to clone 703e7cfd-d248-4e53-8584-2f650394d6c9 from image b69357c8-f1c6-42fd-802c-792fbb69d92d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]). {{(pid=86028) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 20:15:06 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f" returned: 0 in 5.755s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:15:06 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Converted 1024.00 MB image at 177.86 MB/s Aug 28 20:15:06 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f is being set with open permissions: ugo+rw Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:06 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f Aug 28 20:15:06 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 20:15:06 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Image download 20.69 MB at 20.69 MB/s Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd04017-5e29-4d46-98fb-88c220e8a6af]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:06 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f" returned: 0 in 0.329s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-cc0ca944-68b3-4b48-98b4-986d1a46267f" released by "_copy_volume_from_snapshot" :: held 7.047s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:06 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD Aug 28 20:15:06 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-412a64d7-0327-49bb-8804-7a7295e378a7-cc0ca944-68b3-4b48-98b4-986d1a46267f" released by "_create_volume_from_snapshot" :: held 7.115s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.134s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b5d979-7d11-4215-821f-f6e67126f5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0ca944-68b3-4b48-98b4-986d1a46267f', 'volume_size': 1, 'snapshot_id': '412a64d7-0327-49bb-8804-7a7295e378a7'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb06f9e-5e7d-407b-bfc4-f6d6ad749bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:06 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Volume volume-cc0ca944-68b3-4b48-98b4-986d1a46267f (cc0ca944-68b3-4b48-98b4-986d1a46267f): created successfully Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb06f9e-5e7d-407b-bfc4-f6d6ad749bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Flow 'volume_create_manager' (59924919-ee82-4a2e-8437-32a04fd3f28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:15:06 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-275fa1c1-af6f-405d-a282-aea39edb1379 tempest-VolumesSnapshotTestJSON-378924921 None] Created volume successfully. Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:06 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:15:06 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:06 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Temporary image b69357c8-f1c6-42fd-802c-792fbb69d92d is fetched for user 2da437f1bb894bd49083cebf7037e46b. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95f7e24-dd50-454b-8735-3d9b113149be]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:06 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.293s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:15:07 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD Aug 28 20:15:07 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-cc0ca944-68b3-4b48-98b4-986d1a46267f-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:07 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-860426982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703e7cfd-d248-4e53-8584-2f650394d6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bedc2800c5b4bb58c5158f75245bc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:15:04Z,use_quota=True,user_id='2da437f1bb894bd49083cebf7037e46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Creating volume 703e7cfd-d248-4e53-8584-2f650394d6c9 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:15:07 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-cc0ca944-68b3-4b48-98b4-986d1a46267f-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:07 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 1073741824 Aug 28 20:15:07 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-cc0ca944-68b3-4b48-98b4-986d1a46267f" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-cc0ca944-68b3-4b48-98b4-986d1a46267f" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e62d3-b33b-45d2-a7dd-5a4078e1debf]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:07 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-fd457c75-69ac-43cc-82b4-293e4831d43d req-29b1c54c-5028-402c-9915-1b26064c017c tempest-AttachVolumeTestJSON-717553024 None] Terminate volume connection completed successfully. Aug 28 20:15:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fd457c75-69ac-43cc-82b4-293e4831d43d req-29b1c54c-5028-402c-9915-1b26064c017c tempest-AttachVolumeTestJSON-717553024 None] Deleting attachment a46367d0-d720-42c2-94f6-5c3a5c7fed57. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:15:07 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f Aug 28 20:15:07 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:08 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 1073741824" returned: 0 in 0.607s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:08 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f" returned: 0 in 0.472s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:08 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 Aug 28 20:15:08 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:08 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f Aug 28 20:15:08 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:08 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9" returned: 0 in 0.283s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:08 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cc0ca944-68b3-4b48-98b4-986d1a46267f" returned: 0 in 0.297s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Attempting download of b69357c8-f1c6-42fd-802c-792fbb69d92d ((None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}])) to volume 703e7cfd-d248-4e53-8584-2f650394d6c9. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-cc0ca944-68b3-4b48-98b4-986d1a46267f" released by "delete_volume" :: held 0.837s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Created reservations ['78191a4e-5420-47a2-9671-e7c22e6adc4e', '65808551-795a-47f2-90d6-0336ea66837f', 'c99c1950-09dd-4bd7-9846-9d1898fcd209', '26c8f5b0-6050-4f9a-9df6-77edb91c8d88'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecafd74e-7640-4866-b252-f69e35dbd143]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_6h9ajz6i {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:08 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:15:08 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:08 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_6h9ajz6i Aug 28 20:15:08 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-412a64d7-0327-49bb-8804-7a7295e378a7-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-412a64d7-0327-49bb-8804-7a7295e378a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-38b841f4-2565-4afa-9aae-9adfaea4af35" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-38b841f4-2565-4afa-9aae-9adfaea4af35" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-412a64d7-0327-49bb-8804-7a7295e378a7" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-412a64d7-0327-49bb-8804-7a7295e378a7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Deleting offline snapshot 412a64d7-0327-49bb-8804-7a7295e378a7 of volume 38b841f4-2565-4afa-9aae-9adfaea4af35 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] snapshot_file for this snap is: volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac136a2-945b-4c34-b1fe-35e5fd509be9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:09 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.344s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:15:09 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Deleted volume successfully. Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaf9fc12-5377-41b3-a3ad-a09e5293caf0 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-cc0ca944-68b3-4b48-98b4-986d1a46267f-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:09 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_6h9ajz6i" returned: 0 in 0.646s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_6h9ajz6i {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:09 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 Aug 28 20:15:09 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:09 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_6h9ajz6i Aug 28 20:15:09 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:09 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7" returned: 0 in 0.434s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38b841f4-2565-4afa-9aae-9adfaea4af35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2c031e-2cce-4202-bbc4-511e9515f99c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:09 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_6h9ajz6i" returned: 1 in 0.373s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_6h9ajz6i' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[55609129-c6fd-4de5-9014-54ca25c28cf0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:09 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 Aug 28 20:15:09 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:09 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD Aug 28 20:15:09 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:09 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] b69357c8-f1c6-42fd-802c-792fbb69d92d was qcow2, converting to qcow2 {{(pid=86028) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:09 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 Aug 28 20:15:09 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:09 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35" returned: 0 in 0.560s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:10 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 Aug 28 20:15:10 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:10 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7" returned: 0 in 0.462s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:10 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7 Aug 28 20:15:10 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:10 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35.412a64d7-0327-49bb-8804-7a7295e378a7" returned: 0 in 0.283s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-412a64d7-0327-49bb-8804-7a7295e378a7" released by "_delete_snapshot" :: held 1.922s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-38b841f4-2565-4afa-9aae-9adfaea4af35" released by "delete_snapshot" :: held 1.967s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:10 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Created reservations ['c558aabd-f8d5-4608-a5c1-3c658b86b941', '5d816b34-d1ad-45f0-99b4-1484f753ef11', '7d6276d5-76a4-4e2e-aec8-ce0268c76eb5', '3ca6a291-efb9-4ce4-9642-7a84660991f2'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:15:11 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Delete snapshot completed successfully. Aug 28 20:15:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7b70f72-22aa-4b25-8479-ae6a46a27420 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-412a64d7-0327-49bb-8804-7a7295e378a7-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-38b841f4-2565-4afa-9aae-9adfaea4af35-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-38b841f4-2565-4afa-9aae-9adfaea4af35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-38b841f4-2565-4afa-9aae-9adfaea4af35" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-38b841f4-2565-4afa-9aae-9adfaea4af35" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d7e5d0-b18d-4d12-a977-b6abaaafe295]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:12 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9" returned: 0 in 2.530s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_6no2ew9cdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:15:12 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Converted 112.00 MB image at 44.24 MB/s Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:12 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 1G Aug 28 20:15:12 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:12 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 Aug 28 20:15:12 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:12 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 1G" returned: 0 in 0.428s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Downloaded image b69357c8-f1c6-42fd-802c-792fbb69d92d ((None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}])) to volume 703e7cfd-d248-4e53-8584-2f650394d6c9 successfully. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Temporary image b69357c8-f1c6-42fd-802c-792fbb69d92d for user 2da437f1bb894bd49083cebf7037e46b is deleted. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Marking volume 703e7cfd-d248-4e53-8584-2f650394d6c9 as bootable. {{(pid=86028) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Copying metadata from image b69357c8-f1c6-42fd-802c-792fbb69d92d to 703e7cfd-d248-4e53-8584-2f650394d6c9. {{(pid=86028) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 20:15:12 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Creating volume glance metadata for volume 703e7cfd-d248-4e53-8584-2f650394d6c9 backed by image b69357c8-f1c6-42fd-802c-792fbb69d92d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86028) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145a9eab-275b-482c-bc9d-2de3cc35b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703e7cfd-d248-4e53-8584-2f650394d6c9', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a94343-0736-4cc3-a55a-6c012e6090bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:13 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Volume volume-703e7cfd-d248-4e53-8584-2f650394d6c9 (703e7cfd-d248-4e53-8584-2f650394d6c9): created successfully Aug 28 20:15:13 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a94343-0736-4cc3-a55a-6c012e6090bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Flow 'volume_create_manager' (74a432ac-660d-497a-abbc-91d0a06e32ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35" returned: 0 in 0.779s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:13 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35 Aug 28 20:15:13 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:13 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3b803b92-3273-4cfa-b9de-db95f9f8016c tempest-ServerActionsTestOtherA-233550491 None] Created volume successfully. Aug 28 20:15:13 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38b841f4-2565-4afa-9aae-9adfaea4af35" returned: 0 in 0.403s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-38b841f4-2565-4afa-9aae-9adfaea4af35" released by "delete_volume" :: held 1.290s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Created reservations ['a188b875-9fb3-4c81-b3be-76f664cd8d96', 'cd9d67a1-c904-44be-8145-ceb8960472b5', 'd7d431f6-5a8a-4deb-8405-f341aad06549', '27e1cb90-4dd8-4655-a3b8-2f36e2e4ecdb'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:13 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:15:13 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:14 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.485s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:14 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:15:14 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Deleted volume successfully. Aug 28 20:15:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-28cd7c5a-52b9-437b-be43-f994d344a2d1 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-38b841f4-2565-4afa-9aae-9adfaea4af35-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-e0830563-b488-4105-8c6e-f6d8e749a443-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-e0830563-b488-4105-8c6e-f6d8e749a443-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "cinder-quobyte-e0830563-b488-4105-8c6e-f6d8e749a443" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-e0830563-b488-4105-8c6e-f6d8e749a443" acquired by "delete_volume" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:14 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eff6a6-f0ad-42a8-95f3-f3a8c2419f3d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:15 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 Aug 28 20:15:15 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Flow 'volume_create_manager' (551a41ea-9853-4077-9694-4a9414caad3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d415ffd5-ba87-4e5f-9a91-bba5da5d8dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d415ffd5-ba87-4e5f-9a91-bba5da5d8dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-210533265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa671fc-7516-494b-9c9b-ae8eeee93855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7168179e6ef45ccba0a144ba609b16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:15:15Z,use_quota=True,user_id='bc65f00e5b4a48dd8767d44d1c1af1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0173d742-cd2a-46c1-a7cc-495a3686a708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0173d742-cd2a-46c1-a7cc-495a3686a708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7aab1cc-6276-429d-9948-e62c2db05faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7aab1cc-6276-429d-9948-e62c2db05faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa671fc-7516-494b-9c9b-ae8eeee93855', 'volume_name': 'volume-afa671fc-7516-494b-9c9b-ae8eeee93855', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b818332f-de40-4c30-a6d2-872ebe3dd5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b818332f-de40-4c30-a6d2-872ebe3dd5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e410d444-86e8-4596-ae0d-58d8427dad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:15 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Volume afa671fc-7516-494b-9c9b-ae8eeee93855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa671fc-7516-494b-9c9b-ae8eeee93855', 'volume_size': 1} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-210533265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa671fc-7516-494b-9c9b-ae8eeee93855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7168179e6ef45ccba0a144ba609b16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:15:15Z,use_quota=True,user_id='bc65f00e5b4a48dd8767d44d1c1af1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Creating volume afa671fc-7516-494b-9c9b-ae8eeee93855 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:15:15 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:15 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 1073741824 Aug 28 20:15:15 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:15 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443" returned: 0 in 0.542s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:15 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443 Aug 28 20:15:15 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:16 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0830563-b488-4105-8c6e-f6d8e749a443" returned: 0 in 0.546s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:16 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 1073741824" returned: 0 in 0.636s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-quobyte-e0830563-b488-4105-8c6e-f6d8e749a443" released by "delete_volume" :: held 1.208s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:16 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 Aug 28 20:15:16 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Created reservations ['034a8b2f-5cc2-4035-a889-b5a3ae2b8b27', 'a9c06a8e-7bc0-42d9-ad44-634cdecbfc66', '7d2ac2e7-4a6f-44d4-b57f-3c5e78cfc1cd', 'd1e037dd-e480-4d2c-8aed-d824fccb981b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:16 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:15:16 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:16 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e410d444-86e8-4596-ae0d-58d8427dad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa671fc-7516-494b-9c9b-ae8eeee93855', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0b4450-c3a2-4c32-b8eb-ff3befb2b963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=137,cinder:SELECT=130,cinder:DELETE=11,cinder:INSERT=37 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:15:16 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Volume volume-afa671fc-7516-494b-9c9b-ae8eeee93855 (afa671fc-7516-494b-9c9b-ae8eeee93855): created successfully Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0b4450-c3a2-4c32-b8eb-ff3befb2b963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:15:16 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Flow 'volume_create_manager' (551a41ea-9853-4077-9694-4a9414caad3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=147,cinder:UPDATE=124,cinder:INSERT=35,cinder:DELETE=5 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.331s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:15:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9f371636-b513-4464-a463-d540adb9b64b tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Created volume successfully. Aug 28 20:15:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Deleted volume successfully. Aug 28 20:15:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d7bd5f5b-b612-4479-ab83-e8c0d9dbc718 tempest-VolumesSnapshotTestJSON-378924921 None] Lock "cinder-e0830563-b488-4105-8c6e-f6d8e749a443-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Creating offline snapshot c0287d8d-564b-4240-b815-32e2b6e7f21e of volume afa671fc-7516-494b-9c9b-ae8eeee93855 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:15:17 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[577237db-457f-40ac-8dd7-066f8324536f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:17 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 Aug 28 20:15:17 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:18 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855" returned: 0 in 0.554s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:18 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e 1G Aug 28 20:15:18 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-ce8d21c3-88a1-4073-baa2-02409c701b63 req-d53f2827-8429-4b5a-9161-55b1cca6eb1d tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:18 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e 1G" returned: 0 in 0.643s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afa671fc-7516-494b-9c9b-ae8eeee93855 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:19 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afa671fc-7516-494b-9c9b-ae8eeee93855 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e Aug 28 20:15:19 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:19 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afa671fc-7516-494b-9c9b-ae8eeee93855 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e" returned: 0 in 0.424s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:19 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e is being set with open permissions: ugo+rw Aug 28 20:15:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:19 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e Aug 28 20:15:19 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:19 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:19 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.info Aug 28 20:15:19 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:20 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.info" returned: 0 in 0.352s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:20 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.info is being set with open permissions: ugo+rw Aug 28 20:15:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:20 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.info Aug 28 20:15:20 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:20 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.info" returned: 0 in 0.481s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-ce8d21c3-88a1-4073-baa2-02409c701b63 req-d53f2827-8429-4b5a-9161-55b1cca6eb1d tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.936s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-ce8d21c3-88a1-4073-baa2-02409c701b63 req-d53f2827-8429-4b5a-9161-55b1cca6eb1d tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:20 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ba077e69-7f06-4ba3-8471-5ebc04577294 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Create snapshot completed successfully Aug 28 20:15:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-ce8d21c3-88a1-4073-baa2-02409c701b63 req-d53f2827-8429-4b5a-9161-55b1cca6eb1d tempest-ServerActionsTestOtherA-233550491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-703e7cfd-d248-4e53-8584-2f650394d6c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '154135d9-c07f-4026-8c96-7a3ad502f4ed', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:15:20 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-ce8d21c3-88a1-4073-baa2-02409c701b63 req-d53f2827-8429-4b5a-9161-55b1cca6eb1d tempest-ServerActionsTestOtherA-233550491 None] attachment_update completed successfully. Aug 28 20:15:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Acquiring lock "cinder-c0287d8d-564b-4240-b815-32e2b6e7f21e-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "cinder-c0287d8d-564b-4240-b815-32e2b6e7f21e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Acquiring lock "cinder-quobyte-afa671fc-7516-494b-9c9b-ae8eeee93855" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "cinder-quobyte-afa671fc-7516-494b-9c9b-ae8eeee93855" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Acquiring lock "cinder-quobyte-c0287d8d-564b-4240-b815-32e2b6e7f21e" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "cinder-quobyte-c0287d8d-564b-4240-b815-32e2b6e7f21e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Deleting offline snapshot c0287d8d-564b-4240-b815-32e2b6e7f21e of volume afa671fc-7516-494b-9c9b-ae8eeee93855 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:15:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] snapshot_file for this snap is: volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:15:21 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[129ef3d2-983b-4826-92d6-917890044f2d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:21 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e Aug 28 20:15:21 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:22 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e" returned: 0 in 0.848s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afa671fc-7516-494b-9c9b-ae8eeee93855(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:15:22 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a25d79-ae47-4898-b31e-c7c08ce9e9d5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:22 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 Aug 28 20:15:22 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:23 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855" returned: 0 in 0.570s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:23 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e Aug 28 20:15:23 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:24 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e" returned: 0 in 0.833s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:24 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e Aug 28 20:15:24 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:24 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855.c0287d8d-564b-4240-b815-32e2b6e7f21e" returned: 0 in 0.401s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "cinder-quobyte-c0287d8d-564b-4240-b815-32e2b6e7f21e" released by "_delete_snapshot" :: held 2.829s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "cinder-quobyte-afa671fc-7516-494b-9c9b-ae8eeee93855" released by "delete_snapshot" :: held 2.869s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:24 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Created reservations ['2987a6e8-d0e5-471b-8464-199778bbdb29', '15559de0-da4a-4b84-ae5a-b9ecd3496e6e', '0da1c499-0287-4b0a-8ccb-86ae17d115f9', '64700105-af67-4fa9-9828-45bf04538f05'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:15:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Delete snapshot completed successfully. Aug 28 20:15:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-78abc047-befe-422d-b87b-ae52abed471d tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "cinder-c0287d8d-564b-4240-b815-32e2b6e7f21e-delete_snapshot" released by "delete_snapshot" :: held 3.137s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Acquiring lock "cinder-afa671fc-7516-494b-9c9b-ae8eeee93855-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "cinder-afa671fc-7516-494b-9c9b-ae8eeee93855-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Acquiring lock "cinder-quobyte-afa671fc-7516-494b-9c9b-ae8eeee93855" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:15:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "cinder-quobyte-afa671fc-7516-494b-9c9b-ae8eeee93855" acquired by "delete_volume" :: waited 0.053s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:15:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7f9c9f-d30a-4f3a-83b2-c1881996e757]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:15:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:25 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 Aug 28 20:15:25 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:26 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855" returned: 0 in 0.562s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:26 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855 Aug 28 20:15:26 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:26 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afa671fc-7516-494b-9c9b-ae8eeee93855" returned: 0 in 0.339s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "cinder-quobyte-afa671fc-7516-494b-9c9b-ae8eeee93855" released by "delete_volume" :: held 1.044s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Created reservations ['d5f7942a-e2b7-4b44-891e-60daa394faee', '54e65ff9-9178-4593-ad1d-cce1da31a63d', '44af038a-e578-4d50-b5e2-7863c15ae9d7', 'f967a3d9-7af4-4465-b711-2346f749a746'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:15:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:15:26 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:15:26 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:15:27 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Aug 28 20:15:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.366s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:15:27 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:15:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Deleted volume successfully. Aug 28 20:15:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bc83dc51-7107-492d-b3bd-5931b7c34752 tempest-VolumeSnapshotQuotasNegativeTestJSON-1600341534 None] Lock "cinder-afa671fc-7516-494b-9c9b-ae8eeee93855-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:15:36 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:DELETE=3,cinder:SELECT=16,cinder:UPDATE=16,cinder:INSERT=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:15:37 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:15:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-1aae8038-6f4d-49db-83d3-bb19cdcaaa1f req-a4236a1b-f258-4fd5-b24b-8ea2cb29d062 tempest-ServerActionsTestOtherA-233550491 None] Terminate volume connection completed successfully. Aug 28 20:15:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-1aae8038-6f4d-49db-83d3-bb19cdcaaa1f req-a4236a1b-f258-4fd5-b24b-8ea2cb29d062 tempest-ServerActionsTestOtherA-233550491 None] Deleting attachment 154135d9-c07f-4026-8c96-7a3ad502f4ed. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:15:58 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:15:58 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:16:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-1aae8038-6f4d-49db-83d3-bb19cdcaaa1f req-a5be0165-7213-473c-bab2-03f303e4a7f9 tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-1aae8038-6f4d-49db-83d3-bb19cdcaaa1f req-a5be0165-7213-473c-bab2-03f303e4a7f9 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-1aae8038-6f4d-49db-83d3-bb19cdcaaa1f req-a5be0165-7213-473c-bab2-03f303e4a7f9 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-1aae8038-6f4d-49db-83d3-bb19cdcaaa1f req-a5be0165-7213-473c-bab2-03f303e4a7f9 tempest-ServerActionsTestOtherA-233550491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-703e7cfd-d248-4e53-8584-2f650394d6c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6150d1dc-0a34-4ecc-95e2-aac196026f37', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:16:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-1aae8038-6f4d-49db-83d3-bb19cdcaaa1f req-a5be0165-7213-473c-bab2-03f303e4a7f9 tempest-ServerActionsTestOtherA-233550491 None] attachment_update completed successfully. Aug 28 20:16:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:16:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:06 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:16:06 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:07 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.741s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:16:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:16:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:16:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:16:12 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:16:12 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:16:25 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:16:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (47caf427-11ac-4775-b720-edc87c8c187e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4fb8ec-4f16-40fd-8c85-bad49678d6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4fb8ec-4f16-40fd-8c85-bad49678d6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-449591700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a50e73-9c41-4495-ad1f-d31bb8eae22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:26Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c56ea63-2bdd-49ec-ac3f-fb5167efa032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c56ea63-2bdd-49ec-ac3f-fb5167efa032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad952913-fe36-44ae-a8b9-2d64868a7ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad952913-fe36-44ae-a8b9-2d64868a7ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75a50e73-9c41-4495-ad1f-d31bb8eae22a', 'volume_name': 'volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9f9a5d-c5ea-45b4-9013-00c08291e888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9f9a5d-c5ea-45b4-9013-00c08291e888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65318f4b-2905-4da6-803d-acd82b9a98bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:26 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Volume 75a50e73-9c41-4495-ad1f-d31bb8eae22a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a', 'volume_size': 1} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-449591700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a50e73-9c41-4495-ad1f-d31bb8eae22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:26Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Creating volume 75a50e73-9c41-4495-ad1f-d31bb8eae22a {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:16:26 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:26 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a 1073741824 Aug 28 20:16:26 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Flow 'volume_create_manager' (61797fa7-9435-4bf2-8618-c2df8d37f385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dc8845-0798-4548-b175-f131ab72215e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dc8845-0798-4548-b175-f131ab72215e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-803679314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068e8d98-8cff-480c-855c-71770cbc1f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4d5e1031ce40a19de26dac6a09b519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:26Z,use_quota=True,user_id='20d66787a70f4682be6985893832e92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f00d52-31e3-4002-a1ce-4e68dfc819ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f00d52-31e3-4002-a1ce-4e68dfc819ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d69a971-0057-492b-99d8-78da20e8af50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d69a971-0057-492b-99d8-78da20e8af50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '068e8d98-8cff-480c-855c-71770cbc1f80', 'volume_name': 'volume-068e8d98-8cff-480c-855c-71770cbc1f80', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c0402d-c937-4db7-bc62-7c1aa2a63579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c0402d-c937-4db7-bc62-7c1aa2a63579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb471799-eac3-4f63-9973-6d44fd2a029b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:26 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Volume 068e8d98-8cff-480c-855c-71770cbc1f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-068e8d98-8cff-480c-855c-71770cbc1f80', 'volume_size': 1} Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:26 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a 1073741824" returned: 0 in 0.866s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:27 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a Aug 28 20:16:27 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:27 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a" returned: 0 in 0.328s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.042s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-803679314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068e8d98-8cff-480c-855c-71770cbc1f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4d5e1031ce40a19de26dac6a09b519',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:26Z,use_quota=True,user_id='20d66787a70f4682be6985893832e92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Creating volume 068e8d98-8cff-480c-855c-71770cbc1f80 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:16:27 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:27 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80 1073741824 Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65318f4b-2905-4da6-803d-acd82b9a98bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:27 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87868fd3-d5f1-46ff-81a8-e901b5cdc717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:27 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Volume volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a (75a50e73-9c41-4495-ad1f-d31bb8eae22a): created successfully Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87868fd3-d5f1-46ff-81a8-e901b5cdc717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (47caf427-11ac-4775-b720-edc87c8c187e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-78012ad8-3a1c-49c6-b978-79ef0f593f4e tempest-VolumesActionsTest-812320310 None] Created volume successfully. Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bb2eee66-b9b6-4045-a2b4-5ae67da99409 tempest-VolumesActionsTest-812320310 None] Acquiring lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a" by "attach_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:28 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80 1073741824" returned: 0 in 0.714s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bb2eee66-b9b6-4045-a2b4-5ae67da99409 tempest-VolumesActionsTest-812320310 None] Lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a" acquired by "attach_volume" :: waited 0.045s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:28 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80 Aug 28 20:16:28 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-bb2eee66-b9b6-4045-a2b4-5ae67da99409 tempest-VolumesActionsTest-812320310 None] Attaching volume 75a50e73-9c41-4495-ad1f-d31bb8eae22a to instance ae9c0a8f-4f84-4e14-9947-1e90ae5e5ba7 at mountpoint /dev/vdb on host None. Aug 28 20:16:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-bb2eee66-b9b6-4045-a2b4-5ae67da99409 tempest-VolumesActionsTest-812320310 None] Attach volume completed successfully. Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bb2eee66-b9b6-4045-a2b4-5ae67da99409 tempest-VolumesActionsTest-812320310 None] Lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a" released by "attach_volume" :: held 0.315s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:28 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80" returned: 0 in 0.438s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb471799-eac3-4f63-9973-6d44fd2a029b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-068e8d98-8cff-480c-855c-71770cbc1f80', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39e88e4-cb31-46cb-b1f5-fd6a9a03da9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:28 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Volume volume-068e8d98-8cff-480c-855c-71770cbc1f80 (068e8d98-8cff-480c-855c-71770cbc1f80): created successfully Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39e88e4-cb31-46cb-b1f5-fd6a9a03da9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Flow 'volume_create_manager' (61797fa7-9435-4bf2-8618-c2df8d37f385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2e25b03b-086d-4a9a-a638-0b3ccc10f81e tempest-TestMinimumBasicScenario-1382497278 None] Created volume successfully. Aug 28 20:16:29 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-91eae733-802c-4d77-9488-4258070c2ee1 tempest-VolumesActionsTest-736043997 None] Terminate volume connection completed successfully. Aug 28 20:16:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-91eae733-802c-4d77-9488-4258070c2ee1 tempest-VolumesActionsTest-736043997 None] Acquiring lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a-detach_volume" by "detach_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-91eae733-802c-4d77-9488-4258070c2ee1 tempest-VolumesActionsTest-736043997 None] Lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:29 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-91eae733-802c-4d77-9488-4258070c2ee1 tempest-VolumesActionsTest-736043997 None] Detaching volume 75a50e73-9c41-4495-ad1f-d31bb8eae22a from instance ae9c0a8f-4f84-4e14-9947-1e90ae5e5ba7. Aug 28 20:16:29 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-91eae733-802c-4d77-9488-4258070c2ee1 tempest-VolumesActionsTest-736043997 None] Detach volume completed successfully. Aug 28 20:16:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-91eae733-802c-4d77-9488-4258070c2ee1 tempest-VolumesActionsTest-736043997 None] Lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-06138d4a-3af7-4b9d-9acd-168a7e9f6e92 tempest-VolumesActionsTest-812320310 None] Acquiring lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a-detach_volume" by "detach_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-06138d4a-3af7-4b9d-9acd-168a7e9f6e92 tempest-VolumesActionsTest-812320310 None] Lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:29 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-06138d4a-3af7-4b9d-9acd-168a7e9f6e92 tempest-VolumesActionsTest-812320310 None] Volume detach called, but volume not attached. Aug 28 20:16:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-06138d4a-3af7-4b9d-9acd-168a7e9f6e92 tempest-VolumesActionsTest-812320310 None] Lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Acquiring lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Acquiring lock "cinder-quobyte-75a50e73-9c41-4495-ad1f-d31bb8eae22a" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Lock "cinder-quobyte-75a50e73-9c41-4495-ad1f-d31bb8eae22a" acquired by "delete_volume" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:30 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0531907-4334-4690-ad75-5353c884c9f8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:16:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:30 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a Aug 28 20:16:30 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-53e63a2a-84ac-4854-a854-d7ac69e6b7b5 req-31cbe96c-62d9-4eb8-84d1-154672dd0000 tempest-TestMinimumBasicScenario-1382497278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-53e63a2a-84ac-4854-a854-d7ac69e6b7b5 req-31cbe96c-62d9-4eb8-84d1-154672dd0000 tempest-TestMinimumBasicScenario-1382497278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:31 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a" returned: 0 in 0.758s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-53e63a2a-84ac-4854-a854-d7ac69e6b7b5 req-31cbe96c-62d9-4eb8-84d1-154672dd0000 tempest-TestMinimumBasicScenario-1382497278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:31 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a Aug 28 20:16:31 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-53e63a2a-84ac-4854-a854-d7ac69e6b7b5 req-31cbe96c-62d9-4eb8-84d1-154672dd0000 tempest-TestMinimumBasicScenario-1382497278 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-068e8d98-8cff-480c-855c-71770cbc1f80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a7b1e82-b7f1-4063-bc0a-e8cbfbbb4f7a', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:16:31 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-53e63a2a-84ac-4854-a854-d7ac69e6b7b5 req-31cbe96c-62d9-4eb8-84d1-154672dd0000 tempest-TestMinimumBasicScenario-1382497278 None] attachment_update completed successfully. Aug 28 20:16:31 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-75a50e73-9c41-4495-ad1f-d31bb8eae22a" returned: 0 in 0.449s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Lock "cinder-quobyte-75a50e73-9c41-4495-ad1f-d31bb8eae22a" released by "delete_volume" :: held 1.282s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Created reservations ['637125fa-8cd0-42e8-81d6-17c5ce78fd93', 'dc72e393-2384-4dc9-b121-a7e36d4ef7e9', '6d2f3ead-30af-4068-9338-d8d183967131', 'efe2ac08-9fdf-4c52-860c-5c6ac64416b6'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:31 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:16:31 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:32 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.437s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:32 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:16:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Deleted volume successfully. Aug 28 20:16:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3004fba6-27d9-42ca-8270-56dda4fcbb12 tempest-VolumesActionsTest-812320310 None] Lock "cinder-75a50e73-9c41-4495-ad1f-d31bb8eae22a-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:38 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (f4280aab-3786-43f4-9d10-1e044cde8ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048f2e2e-6fea-41c2-b742-291342561e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048f2e2e-6fea-41c2-b742-291342561e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1026654323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca37d8c-5f4d-46b3-9424-d9c9881f87a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:39Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb83165c-e6b5-4312-968a-52e2e89d20df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb83165c-e6b5-4312-968a-52e2e89d20df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5373e445-eb04-49a4-9339-40188c760752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5373e445-eb04-49a4-9339-40188c760752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca37d8c-5f4d-46b3-9424-d9c9881f87a6', 'volume_name': 'volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625560dc-39c3-4aaf-85f4-0351e7abfc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625560dc-39c3-4aaf-85f4-0351e7abfc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc1bc16-a504-4cf4-bc7b-112ccfc7de86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:39 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Volume 8ca37d8c-5f4d-46b3-9424-d9c9881f87a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6', 'volume_size': 1} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1026654323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca37d8c-5f4d-46b3-9424-d9c9881f87a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:39Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Creating volume 8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:16:39 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:16:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:39 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 1073741824 Aug 28 20:16:39 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:40 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 1073741824" returned: 0 in 1.424s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:40 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 Aug 28 20:16:40 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:41 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6" returned: 0 in 0.733s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:16:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.278s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc1bc16-a504-4cf4-bc7b-112ccfc7de86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9893937b-651b-44b6-973f-57e53341ccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-c01d65ef-c32c-456a-bd5e-8ba61941e7b9 tempest-ServerActionsTestOtherA-233550491 None] Terminate volume connection completed successfully. Aug 28 20:16:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-c01d65ef-c32c-456a-bd5e-8ba61941e7b9 tempest-ServerActionsTestOtherA-233550491 None] Deleting attachment 6150d1dc-0a34-4ecc-95e2-aac196026f37. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:16:41 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Volume volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 (8ca37d8c-5f4d-46b3-9424-d9c9881f87a6): created successfully Aug 28 20:16:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9893937b-651b-44b6-973f-57e53341ccd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (f4280aab-3786-43f4-9d10-1e044cde8ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-52290568-3880-44fa-bd73-3fff7f491a1a tempest-VolumesActionsTest-812320310 None] Created volume successfully. Aug 28 20:16:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "cinder-703e7cfd-d248-4e53-8584-2f650394d6c9-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Lock "cinder-703e7cfd-d248-4e53-8584-2f650394d6c9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "cinder-quobyte-703e7cfd-d248-4e53-8584-2f650394d6c9" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Lock "cinder-quobyte-703e7cfd-d248-4e53-8584-2f650394d6c9" acquired by "delete_volume" :: waited 0.047s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:42 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c68346-c834-4321-8e07-5b718fda9d06]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:16:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:42 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 Aug 28 20:16:42 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Acquiring lock "cinder-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Lock "cinder-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Acquiring lock "cinder-quobyte-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Lock "cinder-quobyte-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f7a49c-407f-40f3-8224-50b20eb00f92]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:43 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9" returned: 0 in 0.892s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:43 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9 Aug 28 20:16:43 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:43 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 Aug 28 20:16:43 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:43 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-703e7cfd-d248-4e53-8584-2f650394d6c9" returned: 0 in 0.353s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Lock "cinder-quobyte-703e7cfd-d248-4e53-8584-2f650394d6c9" released by "delete_volume" :: held 1.334s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG cinder.quota [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Created reservations ['911493e2-70c8-4c60-94a9-9ffe62f2d12a', '67596789-74a3-4aa7-8024-3d405dd8c040', 'da332691-8619-4233-9174-fad27089c524', '65ceaec0-0d38-4aa9-8c7b-623b2189909b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:16:43 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6" returned: 0 in 0.461s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:43 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6 Aug 28 20:16:43 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:43 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:16:43 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:43 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6" returned: 0 in 0.288s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Lock "cinder-quobyte-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6" released by "delete_volume" :: held 0.820s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Created reservations ['88989b88-3a06-429e-a61a-6c46d061929b', '9bd956b6-e13c-486b-a227-84626254e923', '7a404205-2eaf-48ac-9831-ad5cd4d581dc', '2995b4f0-21fa-4dd1-acfa-03cc0c4f5504'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:16:43 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.311s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG cinder.manager [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:16:43 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Deleted volume successfully. Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-31744d81-b75e-4add-ad56-15bebf6fe24c req-60562390-fdc1-4ee1-9690-356862c868ec tempest-ServerActionsTestOtherA-233550491 None] Lock "cinder-703e7cfd-d248-4e53-8584-2f650394d6c9-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:44 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:16:44 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "cinder-8ffa8177-e581-47b5-adae-e130df91deee-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Lock "cinder-8ffa8177-e581-47b5-adae-e130df91deee-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "cinder-quobyte-8ffa8177-e581-47b5-adae-e130df91deee" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Lock "cinder-quobyte-8ffa8177-e581-47b5-adae-e130df91deee" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[44217f54-d5fb-4d11-b0e2-63e36ddc0e5b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:44 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:16:44 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Deleted volume successfully. Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-55bed105-ac0b-4786-80c1-6b778c267c28 tempest-VolumesActionsTest-736043997 None] Lock "cinder-8ca37d8c-5f4d-46b3-9424-d9c9881f87a6-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:44 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee Aug 28 20:16:44 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:44 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee" returned: 0 in 0.456s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:44 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee Aug 28 20:16:44 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (a642560a-1158-4a8a-aa3a-f16cba57f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6411b9-3ee1-4329-93a5-7677883903b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:44 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6411b9-3ee1-4329-93a5-7677883903b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563177775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bef7b2-d7e2-421f-98e9-65d206de0ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:45Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee1c5b1-cfec-4bf8-89d8-c53c68bf1c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee1c5b1-cfec-4bf8-89d8-c53c68bf1c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9028a243-9611-4ff8-a15b-f717a07b942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9028a243-9611-4ff8-a15b-f717a07b942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38bef7b2-d7e2-421f-98e9-65d206de0ceb', 'volume_name': 'volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946e6e12-2595-498b-bb44-7629c8a72c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946e6e12-2595-498b-bb44-7629c8a72c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3eaf13-8e5b-4d10-81a3-2663a60697c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:45 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Volume 38bef7b2-d7e2-421f-98e9-65d206de0ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb', 'volume_size': 1} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563177775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bef7b2-d7e2-421f-98e9-65d206de0ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:45Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Creating volume 38bef7b2-d7e2-421f-98e9-65d206de0ceb {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:16:45 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8ffa8177-e581-47b5-adae-e130df91deee" returned: 0 in 0.358s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:45 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb 1073741824 Aug 28 20:16:45 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Lock "cinder-quobyte-8ffa8177-e581-47b5-adae-e130df91deee" released by "delete_volume" :: held 0.869s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Created reservations ['c0054dec-625b-4c32-a670-997decefdb6d', 'fa7b5ca1-f407-479c-b9ee-90ffd1d5899b', 'ffc4fdd7-7879-4b5a-8663-0991f60cb662', 'fd8e7bee-5e29-4c70-9c0b-d0f907806430'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:45 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:16:45 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:45 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.341s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:16:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Deleted volume successfully. Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ba01b8fe-69e5-48a3-a094-e6cba01d9091 tempest-ServerActionsTestOtherA-233550491 None] Lock "cinder-8ffa8177-e581-47b5-adae-e130df91deee-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:45 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb 1073741824" returned: 0 in 0.644s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:45 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb Aug 28 20:16:45 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:46 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb" returned: 0 in 0.377s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:16:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3eaf13-8e5b-4d10-81a3-2663a60697c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcca224f-8cba-4033-bd67-b8ff87e49977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:46 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Volume volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb (38bef7b2-d7e2-421f-98e9-65d206de0ceb): created successfully Aug 28 20:16:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcca224f-8cba-4033-bd67-b8ff87e49977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (a642560a-1158-4a8a-aa3a-f16cba57f27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:46 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-bf8ad436-f91d-4332-a55d-f6f3951a9bda tempest-VolumesActionsTest-812320310 None] Created volume successfully. Aug 28 20:16:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Acquiring lock "cinder-38bef7b2-d7e2-421f-98e9-65d206de0ceb-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Lock "cinder-38bef7b2-d7e2-421f-98e9-65d206de0ceb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Acquiring lock "cinder-quobyte-38bef7b2-d7e2-421f-98e9-65d206de0ceb" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Lock "cinder-quobyte-38bef7b2-d7e2-421f-98e9-65d206de0ceb" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:47 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edba864-4bdf-4eb7-9c51-dfced353b151]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:16:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:47 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb Aug 28 20:16:47 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:47 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb" returned: 0 in 0.482s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:47 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb Aug 28 20:16:47 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:48 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-38bef7b2-d7e2-421f-98e9-65d206de0ceb" returned: 0 in 0.283s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Lock "cinder-quobyte-38bef7b2-d7e2-421f-98e9-65d206de0ceb" released by "delete_volume" :: held 0.815s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Created reservations ['80d04e06-6888-4b05-bc0a-7083ce32347e', '3010ceeb-7bdc-4412-b507-222cf7b64723', '89a27e65-1844-46d1-80b4-7390d0cf6ab3', '9fe029f1-d2c5-42c6-9587-e187d6b0ec72'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:48 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:16:48 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:48 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.297s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:16:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Deleted volume successfully. Aug 28 20:16:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca014079-56f0-4410-a55f-c8572f8a5ad7 tempest-VolumesActionsTest-736043997 None] Lock "cinder-38bef7b2-d7e2-421f-98e9-65d206de0ceb-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (ba9a99a8-61bb-46ed-8350-fef9f0477c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59913fc1-fa8e-4a27-9f48-88fcc6612272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59913fc1-fa8e-4a27-9f48-88fcc6612272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1430115377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2745f155-e84b-4c70-b6cd-53f674d179e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:49Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f97c74-7b12-451e-9557-e8a539db3183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f97c74-7b12-451e-9557-e8a539db3183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23c9d47-90da-4628-9893-41fb524c4bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23c9d47-90da-4628-9893-41fb524c4bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2745f155-e84b-4c70-b6cd-53f674d179e7', 'volume_name': 'volume-2745f155-e84b-4c70-b6cd-53f674d179e7', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcab7361-6abe-4370-aaca-7cbaa950ca81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcab7361-6abe-4370-aaca-7cbaa950ca81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a53633c-00b7-46e6-8a82-f35b7616243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:49 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Volume 2745f155-e84b-4c70-b6cd-53f674d179e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2745f155-e84b-4c70-b6cd-53f674d179e7', 'volume_size': 1} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1430115377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2745f155-e84b-4c70-b6cd-53f674d179e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:49Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Creating volume 2745f155-e84b-4c70-b6cd-53f674d179e7 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:16:49 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:49 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7 1073741824 Aug 28 20:16:49 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:49 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7 1073741824" returned: 0 in 0.620s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:49 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7 Aug 28 20:16:49 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:50 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7" returned: 0 in 0.284s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:16:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a53633c-00b7-46e6-8a82-f35b7616243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2745f155-e84b-4c70-b6cd-53f674d179e7', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9047df-5392-409a-8220-b71f55ac53d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:50 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Volume volume-2745f155-e84b-4c70-b6cd-53f674d179e7 (2745f155-e84b-4c70-b6cd-53f674d179e7): created successfully Aug 28 20:16:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9047df-5392-409a-8220-b71f55ac53d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (ba9a99a8-61bb-46ed-8350-fef9f0477c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-180fdcfc-1a45-4b6d-a5b8-66ec00c9d4e0 tempest-VolumesActionsTest-812320310 None] Created volume successfully. Aug 28 20:16:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Acquiring lock "cinder-2745f155-e84b-4c70-b6cd-53f674d179e7-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Lock "cinder-2745f155-e84b-4c70-b6cd-53f674d179e7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Acquiring lock "cinder-quobyte-2745f155-e84b-4c70-b6cd-53f674d179e7" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Lock "cinder-quobyte-2745f155-e84b-4c70-b6cd-53f674d179e7" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0362f0-7c45-4ad2-b0cb-88965ce1389d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:16:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:51 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7 Aug 28 20:16:51 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:51 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7" returned: 0 in 0.408s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:51 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7 Aug 28 20:16:51 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:52 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2745f155-e84b-4c70-b6cd-53f674d179e7" returned: 0 in 0.341s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Lock "cinder-quobyte-2745f155-e84b-4c70-b6cd-53f674d179e7" released by "delete_volume" :: held 0.809s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Created reservations ['d511d7d2-32de-4d24-863a-3d50a7f3c139', '2838fe52-6c1b-4d2a-89af-ace1d38e0b8f', '83d8e6cc-1b59-42f5-9398-882c5e2383a7', '3568ba28-a513-4ba1-9fc1-c721db7cabf5'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:52 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:16:52 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:52 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.353s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:16:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Deleted volume successfully. Aug 28 20:16:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb40c93e-eac6-433f-9a75-bf638698a457 tempest-VolumesActionsTest-736043997 None] Lock "cinder-2745f155-e84b-4c70-b6cd-53f674d179e7-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (d4feee73-ee51-48b8-bc35-5d29d480034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fffcc1a-44eb-4553-99c8-b7707e209e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fffcc1a-44eb-4553-99c8-b7707e209e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-683117433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7329212b-3fef-414d-b17e-dc929a98c964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:53Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0b1ab9-6e27-42ef-909c-923d15102de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0b1ab9-6e27-42ef-909c-923d15102de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f4aeb0-a5b9-4eda-9bf0-96e06eb5c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f4aeb0-a5b9-4eda-9bf0-96e06eb5c504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7329212b-3fef-414d-b17e-dc929a98c964', 'volume_name': 'volume-7329212b-3fef-414d-b17e-dc929a98c964', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60a5a10-3b5f-4c3e-9f61-8195bf39fe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60a5a10-3b5f-4c3e-9f61-8195bf39fe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e5ddbf-4379-46c2-a878-187b479ef3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:53 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Volume 7329212b-3fef-414d-b17e-dc929a98c964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7329212b-3fef-414d-b17e-dc929a98c964', 'volume_size': 1} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-683117433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7329212b-3fef-414d-b17e-dc929a98c964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:53Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Creating volume 7329212b-3fef-414d-b17e-dc929a98c964 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:16:53 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:53 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964 1073741824 Aug 28 20:16:53 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:53 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964 1073741824" returned: 0 in 0.543s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:53 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964 Aug 28 20:16:53 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:54 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964" returned: 0 in 0.269s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:16:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e5ddbf-4379-46c2-a878-187b479ef3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7329212b-3fef-414d-b17e-dc929a98c964', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85bc9bd9-129a-415a-a48d-e51df4e66654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:54 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Volume volume-7329212b-3fef-414d-b17e-dc929a98c964 (7329212b-3fef-414d-b17e-dc929a98c964): created successfully Aug 28 20:16:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85bc9bd9-129a-415a-a48d-e51df4e66654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (d4feee73-ee51-48b8-bc35-5d29d480034e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-66bffd5d-52a7-4187-888b-19a56d625340 tempest-VolumesActionsTest-812320310 None] Created volume successfully. Aug 28 20:16:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Acquiring lock "cinder-7329212b-3fef-414d-b17e-dc929a98c964-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Lock "cinder-7329212b-3fef-414d-b17e-dc929a98c964-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Acquiring lock "cinder-quobyte-7329212b-3fef-414d-b17e-dc929a98c964" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:16:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Lock "cinder-quobyte-7329212b-3fef-414d-b17e-dc929a98c964" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:16:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7344c0-b710-41ad-893b-19d45f0c0092]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:16:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:55 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964 Aug 28 20:16:55 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:56 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964" returned: 0 in 0.368s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:56 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964 Aug 28 20:16:56 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:56 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7329212b-3fef-414d-b17e-dc929a98c964" returned: 0 in 0.268s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Lock "cinder-quobyte-7329212b-3fef-414d-b17e-dc929a98c964" released by "delete_volume" :: held 0.699s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Created reservations ['952c4630-a6c2-40c6-8b89-d73cefaac2ff', '57b49d9b-1502-4b47-a78a-216e72c5bc42', '3204b923-9981-467b-bdb6-3431620eba80', '04638446-89ce-4167-8dda-3ec031f64228'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:56 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:16:56 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:56 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.301s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:16:56 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Deleted volume successfully. Aug 28 20:16:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-effe1b0f-19c7-4721-b6ad-9d76192c6b54 tempest-VolumesActionsTest-736043997 None] Lock "cinder-7329212b-3fef-414d-b17e-dc929a98c964-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (aac01f7c-0c7a-4891-9ac6-dc5c2b8e7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ccbfdf-c7a8-4bdd-8eae-3106a123f82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ccbfdf-c7a8-4bdd-8eae-3106a123f82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2031148975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0451fe93-c8b7-458f-b9cd-77f28eab6e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:57Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b78d88-6c6f-43ec-957b-3383d2bab4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b78d88-6c6f-43ec-957b-3383d2bab4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c494ae9-a274-4d85-8b0d-93f7e13c5944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c494ae9-a274-4d85-8b0d-93f7e13c5944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0451fe93-c8b7-458f-b9cd-77f28eab6e46', 'volume_name': 'volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae846ce-d7d6-40e3-82e6-9d8f3fba0130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae846ce-d7d6-40e3-82e6-9d8f3fba0130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d24610c-4a47-4a10-94cf-492a36788953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:57 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Volume 0451fe93-c8b7-458f-b9cd-77f28eab6e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46', 'volume_size': 1} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2031148975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0451fe93-c8b7-458f-b9cd-77f28eab6e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdceaf77b55941e9aa8cf058ddc5a739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:16:57Z,use_quota=True,user_id='e4a7c15e3d62401db958340dd1483904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Creating volume 0451fe93-c8b7-458f-b9cd-77f28eab6e46 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:16:57 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:16:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:57 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46 1073741824 Aug 28 20:16:57 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:58 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46 1073741824" returned: 0 in 0.695s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:16:58 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46 Aug 28 20:16:58 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:16:58 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Aug 28 20:16:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:16:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:16:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:16:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d24610c-4a47-4a10-94cf-492a36788953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae037230-694d-4719-bf16-ac2aaa25e85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:16:58 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Volume volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46 (0451fe93-c8b7-458f-b9cd-77f28eab6e46): created successfully Aug 28 20:16:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae037230-694d-4719-bf16-ac2aaa25e85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:16:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Flow 'volume_create_manager' (aac01f7c-0c7a-4891-9ac6-dc5c2b8e7654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:16:58 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d7155f32-e77d-463c-9b3a-ffe62a657663 tempest-VolumesActionsTest-812320310 None] Created volume successfully. Aug 28 20:17:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Acquiring lock "cinder-0451fe93-c8b7-458f-b9cd-77f28eab6e46-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Lock "cinder-0451fe93-c8b7-458f-b9cd-77f28eab6e46-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Acquiring lock "cinder-quobyte-0451fe93-c8b7-458f-b9cd-77f28eab6e46" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Lock "cinder-quobyte-0451fe93-c8b7-458f-b9cd-77f28eab6e46" acquired by "delete_volume" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:00 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c8bc79-4fa1-4677-ac6a-0d317c2c7c03]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:00 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46 Aug 28 20:17:00 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:00 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46" returned: 0 in 0.444s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:00 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46 Aug 28 20:17:00 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:01 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0451fe93-c8b7-458f-b9cd-77f28eab6e46" returned: 0 in 0.279s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Lock "cinder-quobyte-0451fe93-c8b7-458f-b9cd-77f28eab6e46" released by "delete_volume" :: held 0.782s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Created reservations ['0d4f37b4-9954-43f0-b3b3-5f3c78e685b6', '48bae607-c945-45b0-9da7-8fb1dc40b5d9', 'e4f3e8af-f058-4a70-9c79-2e5be433799d', 'fe46b72e-e977-4e94-bfe2-67f52677959d'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:01 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:01 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:01 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.319s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:01 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Deleted volume successfully. Aug 28 20:17:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9e82c21b-82fb-43d3-911e-1d3228169d2f tempest-VolumesActionsTest-812320310 None] Lock "cinder-0451fe93-c8b7-458f-b9cd-77f28eab6e46-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Flow 'volume_create_manager' (79772b4c-1ed5-408f-9a58-af9f32cee3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2996d28-b1b7-4809-bda6-46948fad7f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2996d28-b1b7-4809-bda6-46948fad7f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-75001703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=725eff51-6979-4bf3-9cf7-540d1c333463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30410eb447684863a44367cac68fd879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:04Z,use_quota=True,user_id='8099f1f37b1a4058866c3b1a2843d4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e6e75e-9e6d-4d9f-875a-0748cc1e4a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e6e75e-9e6d-4d9f-875a-0748cc1e4a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121c37e9-7bc3-46b4-9a78-c86a19f76e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121c37e9-7bc3-46b4-9a78-c86a19f76e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '725eff51-6979-4bf3-9cf7-540d1c333463', 'volume_name': 'volume-725eff51-6979-4bf3-9cf7-540d1c333463', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cc40c6-2a80-47f2-838c-701442858f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cc40c6-2a80-47f2-838c-701442858f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939d05c4-7e41-495d-b9cd-dacce31a8b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:04 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Volume 725eff51-6979-4bf3-9cf7-540d1c333463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-725eff51-6979-4bf3-9cf7-540d1c333463', 'volume_size': 1} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-75001703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=725eff51-6979-4bf3-9cf7-540d1c333463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30410eb447684863a44367cac68fd879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:04Z,use_quota=True,user_id='8099f1f37b1a4058866c3b1a2843d4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Creating volume 725eff51-6979-4bf3-9cf7-540d1c333463 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:17:04 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:17:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:04 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463 1073741824 Aug 28 20:17:04 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:05 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463 1073741824" returned: 0 in 0.729s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:05 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463 Aug 28 20:17:05 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:05 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463" returned: 0 in 0.334s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:17:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939d05c4-7e41-495d-b9cd-dacce31a8b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-725eff51-6979-4bf3-9cf7-540d1c333463', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bb667b-6d87-4202-b75e-3c8b655284d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:05 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Volume volume-725eff51-6979-4bf3-9cf7-540d1c333463 (725eff51-6979-4bf3-9cf7-540d1c333463): created successfully Aug 28 20:17:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bb667b-6d87-4202-b75e-3c8b655284d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Flow 'volume_create_manager' (79772b4c-1ed5-408f-9a58-af9f32cee3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:06 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5b42f03a-4b78-4c90-b5aa-c7e9e0606aff tempest-AttachVolumeTestJSON-717553024 None] Created volume successfully. Aug 28 20:17:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:17:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:06 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:06 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:07 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.454s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:17:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:17:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:17:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-136545ad-db87-49cb-aec3-5329d4a18f7f req-9a74d040-f551-4f14-bd78-f0be270d6a78 tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-136545ad-db87-49cb-aec3-5329d4a18f7f req-9a74d040-f551-4f14-bd78-f0be270d6a78 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-136545ad-db87-49cb-aec3-5329d4a18f7f req-9a74d040-f551-4f14-bd78-f0be270d6a78 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-136545ad-db87-49cb-aec3-5329d4a18f7f req-9a74d040-f551-4f14-bd78-f0be270d6a78 tempest-AttachVolumeTestJSON-717553024 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-725eff51-6979-4bf3-9cf7-540d1c333463', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6833d693-698c-4717-a3dc-765370e0eb85', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:17:08 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-136545ad-db87-49cb-aec3-5329d4a18f7f req-9a74d040-f551-4f14-bd78-f0be270d6a78 tempest-AttachVolumeTestJSON-717553024 None] attachment_update completed successfully. Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Flow 'volume_create_manager' (ddbf73c7-aed3-4d56-aa34-2999c228391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7225339-4f0e-4265-a6c8-95e7c3c5fe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7225339-4f0e-4265-a6c8-95e7c3c5fe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-378812374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31777f3b-a220-478d-aa0f-4e1e81ed6baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30410eb447684863a44367cac68fd879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:11Z,use_quota=True,user_id='8099f1f37b1a4058866c3b1a2843d4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc689ce1-808f-4c4b-89f6-89283c66c599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc689ce1-808f-4c4b-89f6-89283c66c599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f14ad6f-12ff-4e3c-9521-2d6ce68f3bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f14ad6f-12ff-4e3c-9521-2d6ce68f3bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31777f3b-a220-478d-aa0f-4e1e81ed6baf', 'volume_name': 'volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627efc2d-0d3d-4828-a37b-0246c9b798ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627efc2d-0d3d-4828-a37b-0246c9b798ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb35feef-0788-43ab-9c47-64e852c35e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:11 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Volume 31777f3b-a220-478d-aa0f-4e1e81ed6baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf', 'volume_size': 1} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-378812374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31777f3b-a220-478d-aa0f-4e1e81ed6baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30410eb447684863a44367cac68fd879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:11Z,use_quota=True,user_id='8099f1f37b1a4058866c3b1a2843d4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Creating volume 31777f3b-a220-478d-aa0f-4e1e81ed6baf {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:17:11 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:17:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:11 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf 1073741824 Aug 28 20:17:11 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:12 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf 1073741824" returned: 0 in 0.578s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:12 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf Aug 28 20:17:12 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:12 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf" returned: 0 in 0.308s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:17:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb35feef-0788-43ab-9c47-64e852c35e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35df6e77-3b19-4497-a750-2979de6ead39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:12 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Volume volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf (31777f3b-a220-478d-aa0f-4e1e81ed6baf): created successfully Aug 28 20:17:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35df6e77-3b19-4497-a750-2979de6ead39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Flow 'volume_create_manager' (ddbf73c7-aed3-4d56-aa34-2999c228391f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:12 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e9592231-adaa-4f53-bae3-be1de926f666 tempest-AttachVolumeTestJSON-717553024 None] Created volume successfully. Aug 28 20:17:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-e698af3d-abdd-477b-8ba0-47d21decd9fd req-da240d3d-32c3-4d6e-90d1-75e57c7aac3c tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-e698af3d-abdd-477b-8ba0-47d21decd9fd req-da240d3d-32c3-4d6e-90d1-75e57c7aac3c tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-e698af3d-abdd-477b-8ba0-47d21decd9fd req-da240d3d-32c3-4d6e-90d1-75e57c7aac3c tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-e698af3d-abdd-477b-8ba0-47d21decd9fd req-da240d3d-32c3-4d6e-90d1-75e57c7aac3c tempest-AttachVolumeTestJSON-717553024 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee5fbd78-4a81-4fb9-9610-c9acfeb91e29', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:17:14 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-e698af3d-abdd-477b-8ba0-47d21decd9fd req-da240d3d-32c3-4d6e-90d1-75e57c7aac3c tempest-AttachVolumeTestJSON-717553024 None] attachment_update completed successfully. Aug 28 20:17:17 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-a42bd3f4-f82b-4890-be08-cf823963b089 req-b9d3e166-1fbb-4adb-9384-6e541f3bd754 tempest-AttachVolumeTestJSON-717553024 None] Terminate volume connection completed successfully. Aug 28 20:17:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-a42bd3f4-f82b-4890-be08-cf823963b089 req-b9d3e166-1fbb-4adb-9384-6e541f3bd754 tempest-AttachVolumeTestJSON-717553024 None] Deleting attachment 6833d693-698c-4717-a3dc-765370e0eb85. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:17:19 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-ace42c80-9d68-4ab4-b534-a9c2f8f2d48e req-074dcd04-8827-46f3-a904-9e31876f8a5e tempest-AttachVolumeTestJSON-717553024 None] Terminate volume connection completed successfully. Aug 28 20:17:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-ace42c80-9d68-4ab4-b534-a9c2f8f2d48e req-074dcd04-8827-46f3-a904-9e31876f8a5e tempest-AttachVolumeTestJSON-717553024 None] Deleting attachment ee5fbd78-4a81-4fb9-9610-c9acfeb91e29. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:17:23 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=91,cinder:UPDATE=105,cinder:INSERT=18,cinder:DELETE=12 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:17:23 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=86,cinder:UPDATE=94,cinder:INSERT=25,cinder:DELETE=5 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:17:23 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:17:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Flow 'volume_create_manager' (1b588567-7014-42d4-9987-714721dc4251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ef8059-89fb-4bce-8850-b5bfe5ace945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ef8059-89fb-4bce-8850-b5bfe5ace945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1298519372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5450bb5a-1729-4785-a346-b8cc4fa84c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e4f21fd2c24f13bc68c6ada11fedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:24Z,use_quota=True,user_id='9e9cef93bae443ffba0ac44d6f71318d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c8a308-b983-4117-8bc1-49085a162067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c8a308-b983-4117-8bc1-49085a162067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13eb815-5a52-465a-ba1e-9b7e516cd704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13eb815-5a52-465a-ba1e-9b7e516cd704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5450bb5a-1729-4785-a346-b8cc4fa84c7e', 'volume_name': 'volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1e2652-8199-40df-8e2b-aaf45b0b8b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1e2652-8199-40df-8e2b-aaf45b0b8b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af83eefe-3c45-4a90-a92d-f4b02c5814f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:24 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Volume 5450bb5a-1729-4785-a346-b8cc4fa84c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e', 'volume_size': 1} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1298519372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5450bb5a-1729-4785-a346-b8cc4fa84c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e4f21fd2c24f13bc68c6ada11fedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:24Z,use_quota=True,user_id='9e9cef93bae443ffba0ac44d6f71318d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Creating volume 5450bb5a-1729-4785-a346-b8cc4fa84c7e {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:17:24 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:24 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e 1073741824 Aug 28 20:17:24 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:24 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e 1073741824" returned: 0 in 0.831s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:25 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e Aug 28 20:17:25 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:25 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e" returned: 0 in 0.691s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:17:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af83eefe-3c45-4a90-a92d-f4b02c5814f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4865f54-e5ff-4956-b316-39799db4c0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:25 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Volume volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e (5450bb5a-1729-4785-a346-b8cc4fa84c7e): created successfully Aug 28 20:17:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4865f54-e5ff-4956-b316-39799db4c0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Flow 'volume_create_manager' (1b588567-7014-42d4-9987-714721dc4251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:25 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-25c21fc8-568e-4ef7-a521-a4be0b521c92 tempest-VolumesListAdminTestJSON-1300312622 None] Created volume successfully. Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Flow 'volume_create_manager' (8cdd431d-54b3-4210-b4c3-e5090d54df81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5791238-2549-45ec-af2d-d33a66738847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5791238-2549-45ec-af2d-d33a66738847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1237436577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89193e65-c29c-481b-840f-a4b7c7b8b92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e4f21fd2c24f13bc68c6ada11fedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:27Z,use_quota=True,user_id='9e9cef93bae443ffba0ac44d6f71318d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec45e497-874f-4639-9933-114f0b01277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec45e497-874f-4639-9933-114f0b01277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec3682e-8d28-4ab1-9641-db84302742df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec3682e-8d28-4ab1-9641-db84302742df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89193e65-c29c-481b-840f-a4b7c7b8b92f', 'volume_name': 'volume-89193e65-c29c-481b-840f-a4b7c7b8b92f', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87737c35-c92b-40d5-8808-82923cd0f52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87737c35-c92b-40d5-8808-82923cd0f52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40d129b-5afc-4c57-9861-d817077f8ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:27 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Volume 89193e65-c29c-481b-840f-a4b7c7b8b92f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89193e65-c29c-481b-840f-a4b7c7b8b92f', 'volume_size': 1} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1237436577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89193e65-c29c-481b-840f-a4b7c7b8b92f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e4f21fd2c24f13bc68c6ada11fedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:27Z,use_quota=True,user_id='9e9cef93bae443ffba0ac44d6f71318d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Creating volume 89193e65-c29c-481b-840f-a4b7c7b8b92f {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:17:27 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:17:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:27 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f 1073741824 Aug 28 20:17:27 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:28 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f 1073741824" returned: 0 in 1.304s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:28 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f Aug 28 20:17:28 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:29 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-963f73d8-fe46-4554-95be-b60a9d206c27 req-6a6c69dd-f163-4c41-8053-21f346e221a0 tempest-TestMinimumBasicScenario-1382497278 None] Terminate volume connection completed successfully. Aug 28 20:17:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-963f73d8-fe46-4554-95be-b60a9d206c27 req-6a6c69dd-f163-4c41-8053-21f346e221a0 tempest-TestMinimumBasicScenario-1382497278 None] Deleting attachment 7a7b1e82-b7f1-4063-bc0a-e8cbfbbb4f7a. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:17:29 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f" returned: 0 in 0.733s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:17:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40d129b-5afc-4c57-9861-d817077f8ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89193e65-c29c-481b-840f-a4b7c7b8b92f', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3992ea1d-6c2e-44b6-8082-68919ea80056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:29 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Volume volume-89193e65-c29c-481b-840f-a4b7c7b8b92f (89193e65-c29c-481b-840f-a4b7c7b8b92f): created successfully Aug 28 20:17:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3992ea1d-6c2e-44b6-8082-68919ea80056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Flow 'volume_create_manager' (8cdd431d-54b3-4210-b4c3-e5090d54df81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:29 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6dedcb1c-8a85-4f7e-92b9-960fb0702b0a tempest-VolumesListAdminTestJSON-1300312622 None] Created volume successfully. Aug 28 20:17:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "cinder-31777f3b-a220-478d-aa0f-4e1e81ed6baf-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-31777f3b-a220-478d-aa0f-4e1e81ed6baf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "cinder-quobyte-31777f3b-a220-478d-aa0f-4e1e81ed6baf" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-quobyte-31777f3b-a220-478d-aa0f-4e1e81ed6baf" acquired by "delete_volume" :: waited 0.051s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:30 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[469b6927-4d7f-427a-8ac3-26e50cb127f8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:31 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf Aug 28 20:17:31 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Acquiring lock "cinder-068e8d98-8cff-480c-855c-71770cbc1f80-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Lock "cinder-068e8d98-8cff-480c-855c-71770cbc1f80-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Acquiring lock "cinder-quobyte-068e8d98-8cff-480c-855c-71770cbc1f80" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Lock "cinder-quobyte-068e8d98-8cff-480c-855c-71770cbc1f80" acquired by "delete_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9782fb-3fd5-473c-8c07-a7ae29dc748f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:31 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf" returned: 0 in 0.608s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:31 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf Aug 28 20:17:31 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Flow 'volume_create_manager' (ee47595b-7603-4400-987e-ecbeb9610389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:31 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80 Aug 28 20:17:31 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfda539c-8496-4684-be40-17204c9b7871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfda539c-8496-4684-be40-17204c9b7871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1532446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f8a926-17c8-4361-b559-d25f0f0de872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e4f21fd2c24f13bc68c6ada11fedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:31Z,use_quota=True,user_id='9e9cef93bae443ffba0ac44d6f71318d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80119902-56b7-4ca8-ac05-c0b03ed78e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80119902-56b7-4ca8-ac05-c0b03ed78e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54237312-5040-4bd6-8e50-f0a4456adebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54237312-5040-4bd6-8e50-f0a4456adebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79f8a926-17c8-4361-b559-d25f0f0de872', 'volume_name': 'volume-79f8a926-17c8-4361-b559-d25f0f0de872', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e8b9d4-7a99-487c-88d0-4cc83d3a82dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e8b9d4-7a99-487c-88d0-4cc83d3a82dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76b600a-abdf-4823-824b-fbdffb7bbd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:31 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Volume 79f8a926-17c8-4361-b559-d25f0f0de872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79f8a926-17c8-4361-b559-d25f0f0de872', 'volume_size': 1} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1532446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f8a926-17c8-4361-b559-d25f0f0de872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e4f21fd2c24f13bc68c6ada11fedf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:31Z,use_quota=True,user_id='9e9cef93bae443ffba0ac44d6f71318d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Creating volume 79f8a926-17c8-4361-b559-d25f0f0de872 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:17:31 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:31 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872 1073741824 Aug 28 20:17:31 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:31 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-31777f3b-a220-478d-aa0f-4e1e81ed6baf" returned: 0 in 0.331s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-quobyte-31777f3b-a220-478d-aa0f-4e1e81ed6baf" released by "delete_volume" :: held 1.004s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Created reservations ['947c40a8-eb63-4af1-a1bf-f24145331ea5', 'c6c268af-ad79-4918-b4b1-932dab5599d5', '4bb99a6c-7296-4696-a8d5-2018240dcdf0', '02b83dc5-ac5c-4632-bb42-7ff35063efba'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:31 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80" returned: 0 in 0.602s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:31 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:31 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:31 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80 Aug 28 20:17:31 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:32 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:32 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-068e8d98-8cff-480c-855c-71770cbc1f80" returned: 0 in 0.364s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.430s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Lock "cinder-quobyte-068e8d98-8cff-480c-855c-71770cbc1f80" released by "delete_volume" :: held 1.060s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Deleted volume successfully. Aug 28 20:17:32 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872 1073741824" returned: 0 in 0.833s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be2e3dcc-2519-4c77-a2f6-d69f266ade8b tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-31777f3b-a220-478d-aa0f-4e1e81ed6baf-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Created reservations ['c2128d27-72e7-4b1f-88dc-dd5e9fb3b1fc', '0934f273-7d04-428d-8c42-6c5e8552eb65', 'e8836156-c5d6-4fa9-9e98-01d998e0d145', '1ca33474-399d-4049-b04d-80c251bf746c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:32 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872 Aug 28 20:17:32 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:32 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:32 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:32 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872" returned: 0 in 0.363s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76b600a-abdf-4823-824b-fbdffb7bbd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f8a926-17c8-4361-b559-d25f0f0de872', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58daf7d9-e231-44d7-9798-13b1a2f008f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:32 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Volume volume-79f8a926-17c8-4361-b559-d25f0f0de872 (79f8a926-17c8-4361-b559-d25f0f0de872): created successfully Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58daf7d9-e231-44d7-9798-13b1a2f008f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Flow 'volume_create_manager' (ee47595b-7603-4400-987e-ecbeb9610389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-faa8ef78-2798-4c84-a57b-7ff909833fa1 tempest-VolumesListAdminTestJSON-1300312622 None] Created volume successfully. Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "cinder-725eff51-6979-4bf3-9cf7-540d1c333463-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-725eff51-6979-4bf3-9cf7-540d1c333463-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:32 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.378s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:33 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "cinder-quobyte-725eff51-6979-4bf3-9cf7-540d1c333463" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Deleted volume successfully. Aug 28 20:17:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-quobyte-725eff51-6979-4bf3-9cf7-540d1c333463" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d04e6b2-8bac-4d37-a9c6-2b94486afbce tempest-TestMinimumBasicScenario-1382497278 None] Lock "cinder-068e8d98-8cff-480c-855c-71770cbc1f80-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:33 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[05723242-6b1f-4e58-bb27-98e2ad83537b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:33 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463 Aug 28 20:17:33 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:33 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463" returned: 0 in 0.608s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:33 devstack sudo[93933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463 Aug 28 20:17:33 devstack sudo[93933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:34 devstack sudo[93933]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-725eff51-6979-4bf3-9cf7-540d1c333463" returned: 0 in 0.524s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-quobyte-725eff51-6979-4bf3-9cf7-540d1c333463" released by "delete_volume" :: held 1.242s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Created reservations ['0a8a11f9-caf8-44b6-ab57-e809bf0498d8', '8ca6aaae-9966-4e6d-933b-6333d657f503', '9fcd9c42-1909-45e6-81c9-ec5f1e6cc90c', 'cf0cfd54-9409-4365-85a0-c933f81467fc'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:34 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:34 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Flow 'volume_create_manager' (cbc7b635-72a2-4e91-b572-1cdc322ed47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b527725b-1219-4a15-903a-c0230376d253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b527725b-1219-4a15-903a-c0230376d253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c19149f-111e-4031-88e0-2e8271a4df8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2176a43c664cd981cac56326312bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:35Z,use_quota=True,user_id='5c4a73d988f346b09a8a0ff844268c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d8cb78-d9c0-4765-a9e5-844da5676bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:34 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d8cb78-d9c0-4765-a9e5-844da5676bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0821691-548a-4617-8b70-6daf60af9299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0821691-548a-4617-8b70-6daf60af9299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c19149f-111e-4031-88e0-2e8271a4df8f', 'volume_name': 'volume-0c19149f-111e-4031-88e0-2e8271a4df8f', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8c9cbe-866c-4441-94ec-4656047ad81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8c9cbe-866c-4441-94ec-4656047ad81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3836ebf8-af2c-4a84-b066-71278cabb17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:34 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Volume 0c19149f-111e-4031-88e0-2e8271a4df8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c19149f-111e-4031-88e0-2e8271a4df8f', 'volume_size': 1} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c19149f-111e-4031-88e0-2e8271a4df8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2176a43c664cd981cac56326312bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:35Z,use_quota=True,user_id='5c4a73d988f346b09a8a0ff844268c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Creating volume 0c19149f-111e-4031-88e0-2e8271a4df8f {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:17:34 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.384s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:34 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Deleted volume successfully. Aug 28 20:17:34 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f 1073741824 Aug 28 20:17:34 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-978b6c3f-7d3d-495f-a3ec-c3fb2394e3af tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-725eff51-6979-4bf3-9cf7-540d1c333463-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:35 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f 1073741824" returned: 0 in 0.589s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "cinder-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:35 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f Aug 28 20:17:35 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "cinder-quobyte-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-quobyte-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[2861611f-62f3-4524-aadb-179ccc2ee175]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:35 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea Aug 28 20:17:35 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:35 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f" returned: 0 in 0.368s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3836ebf8-af2c-4a84-b066-71278cabb17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c19149f-111e-4031-88e0-2e8271a4df8f', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0284ac-7923-417d-8273-3eed6fed71fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:35 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Volume volume-0c19149f-111e-4031-88e0-2e8271a4df8f (0c19149f-111e-4031-88e0-2e8271a4df8f): created successfully Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0284ac-7923-417d-8273-3eed6fed71fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Flow 'volume_create_manager' (cbc7b635-72a2-4e91-b572-1cdc322ed47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:36 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9470848d-0470-4a45-9239-c37cae5b1176 tempest-VolumesListAdminTestJSON-1846144788 None] Created volume successfully. Aug 28 20:17:36 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea" returned: 0 in 0.449s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:36 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea Aug 28 20:17:36 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:36 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea" returned: 0 in 0.264s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-quobyte-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea" released by "delete_volume" :: held 0.797s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Created reservations ['e8cf6253-7369-420b-8785-1174715dee15', 'd74c24f3-6a0f-4ff6-bca8-21df840ac891', 'e6747431-a8bd-4a75-a5c6-8773c258e44e', 'eb44841d-9b5a-4aa5-81f0-c9061b5f505a'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:36 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:36 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:36 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.276s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:36 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Deleted volume successfully. Aug 28 20:17:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8836661d-4627-4e21-811b-583f0a50908d tempest-AttachVolumeTestJSON-717553024 None] Lock "cinder-d470b697-94cd-4d2b-a3e5-cdfa5ab39dea-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Acquiring lock "cinder-0c19149f-111e-4031-88e0-2e8271a4df8f-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Lock "cinder-0c19149f-111e-4031-88e0-2e8271a4df8f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Acquiring lock "cinder-quobyte-0c19149f-111e-4031-88e0-2e8271a4df8f" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Lock "cinder-quobyte-0c19149f-111e-4031-88e0-2e8271a4df8f" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63f2167-bf3c-4d0b-8d46-80a37ce2e3ad]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "cinder-79f8a926-17c8-4361-b559-d25f0f0de872-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-79f8a926-17c8-4361-b559-d25f0f0de872-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:37 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f Aug 28 20:17:37 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "cinder-quobyte-79f8a926-17c8-4361-b559-d25f0f0de872" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-quobyte-79f8a926-17c8-4361-b559-d25f0f0de872" acquired by "delete_volume" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[569aeaa0-ed59-436d-ac17-369150349cfd]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:37 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872 Aug 28 20:17:37 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:37 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f" returned: 0 in 0.531s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:37 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f Aug 28 20:17:37 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:37 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872" returned: 0 in 0.481s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:38 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872 Aug 28 20:17:38 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:38 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0c19149f-111e-4031-88e0-2e8271a4df8f" returned: 0 in 0.364s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Lock "cinder-quobyte-0c19149f-111e-4031-88e0-2e8271a4df8f" released by "delete_volume" :: held 0.949s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Created reservations ['3ca56cae-b714-48c2-9d24-a2c8db01575d', 'd9edde26-6588-4ac3-8e65-ac3561a55fd3', '7ae6a945-7736-4257-a563-9d194f14d2f2', 'ec9f63ad-da54-4717-a491-4af04c62294d'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:38 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:38 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:38 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79f8a926-17c8-4361-b559-d25f0f0de872" returned: 0 in 0.374s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-quobyte-79f8a926-17c8-4361-b559-d25f0f0de872" released by "delete_volume" :: held 0.990s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Created reservations ['b7a5d64e-ff06-4878-a17f-7b6d2d2fcf16', 'a5ae7723-eebf-4acf-beca-f823d6ecabeb', 'effeffb6-00a1-491b-a845-f0d4e9518661', 'f7ec3362-e2db-4f41-acc8-d548422075fd'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:38 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:38 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:38 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.353s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Deleted volume successfully. Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d3c9abb4-9c1d-44fc-886c-792d59c76e90 tempest-VolumesListAdminTestJSON-1846144788 None] Lock "cinder-0c19149f-111e-4031-88e0-2e8271a4df8f-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "cinder-89193e65-c29c-481b-840f-a4b7c7b8b92f-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-89193e65-c29c-481b-840f-a4b7c7b8b92f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "cinder-quobyte-89193e65-c29c-481b-840f-a4b7c7b8b92f" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-quobyte-89193e65-c29c-481b-840f-a4b7c7b8b92f" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4655aba5-946a-4482-a945-63c2fa36c9ac]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:39 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.441s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Deleted volume successfully. Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-60a8267d-4c11-41ff-b193-34452d3de682 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-79f8a926-17c8-4361-b559-d25f0f0de872-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:39 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f Aug 28 20:17:39 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:39 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f" returned: 0 in 0.548s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:39 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f Aug 28 20:17:39 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Flow 'volume_create_manager' (7dce8c9b-f16d-4dcc-a489-aa8fc069ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149ef76d-56ff-417e-a470-ac09773f01db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:39 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-89193e65-c29c-481b-840f-a4b7c7b8b92f" returned: 0 in 0.386s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-quobyte-89193e65-c29c-481b-840f-a4b7c7b8b92f" released by "delete_volume" :: held 0.998s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149ef76d-56ff-417e-a470-ac09773f01db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-229686118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c572a0-0e53-4014-b974-3b85298d2789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d825cd28b2034c26975206ca1fec67e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:40Z,use_quota=True,user_id='8991fcd975124142867247466e464b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13aae8cb-58c5-49cc-9ba6-b19a9441127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13aae8cb-58c5-49cc-9ba6-b19a9441127e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c953b057-447b-42c0-81c6-ec25deb46ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c953b057-447b-42c0-81c6-ec25deb46ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c572a0-0e53-4014-b974-3b85298d2789', 'volume_name': 'volume-70c572a0-0e53-4014-b974-3b85298d2789', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caae6b87-bacd-4fb8-80b6-a1cbc36cbce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caae6b87-bacd-4fb8-80b6-a1cbc36cbce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe08461-9a6a-4ee3-84e4-abb9c47cd8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:39 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Volume 70c572a0-0e53-4014-b974-3b85298d2789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c572a0-0e53-4014-b974-3b85298d2789', 'volume_size': 1} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-229686118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c572a0-0e53-4014-b974-3b85298d2789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d825cd28b2034c26975206ca1fec67e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:40Z,use_quota=True,user_id='8991fcd975124142867247466e464b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Creating volume 70c572a0-0e53-4014-b974-3b85298d2789 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:17:39 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:17:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:40 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789 1073741824 Aug 28 20:17:40 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Created reservations ['99545f60-aef3-4155-b331-0ff293c85efd', 'b7115da4-6e4e-4512-8561-1d32dd6d9b61', '61381344-7920-4fc4-9154-6013f3f3aebc', '5eea1dbe-1ea3-446c-b81b-c1fe753b6ae2'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:40 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:40 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:40 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.337s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Deleted volume successfully. Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1a225a93-0892-4d00-85fb-18b5a7b6f7a6 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-89193e65-c29c-481b-840f-a4b7c7b8b92f-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:40 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789 1073741824" returned: 0 in 0.867s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:40 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789 Aug 28 20:17:40 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "cinder-5450bb5a-1729-4785-a346-b8cc4fa84c7e-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-5450bb5a-1729-4785-a346-b8cc4fa84c7e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "cinder-quobyte-5450bb5a-1729-4785-a346-b8cc4fa84c7e" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-quobyte-5450bb5a-1729-4785-a346-b8cc4fa84c7e" acquired by "delete_volume" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0def4471-2688-4af4-a67f-79ae7b95e335]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:41 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789" returned: 0 in 0.452s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe08461-9a6a-4ee3-84e4-abb9c47cd8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c572a0-0e53-4014-b974-3b85298d2789', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a22010-7b5b-4e2e-86df-191a2884bcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:41 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Volume volume-70c572a0-0e53-4014-b974-3b85298d2789 (70c572a0-0e53-4014-b974-3b85298d2789): created successfully Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a22010-7b5b-4e2e-86df-191a2884bcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Flow 'volume_create_manager' (7dce8c9b-f16d-4dcc-a489-aa8fc069ada7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-305119bd-22cc-4693-8597-7305e34f7f12 tempest-ServersNegativeTestJSON-1714843588 None] Created volume successfully. Aug 28 20:17:41 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e Aug 28 20:17:41 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:41 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e" returned: 0 in 0.576s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:41 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e Aug 28 20:17:41 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:42 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5450bb5a-1729-4785-a346-b8cc4fa84c7e" returned: 0 in 0.413s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-quobyte-5450bb5a-1729-4785-a346-b8cc4fa84c7e" released by "delete_volume" :: held 1.056s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Created reservations ['f2d156bd-9792-418f-a41c-ef279e554284', '4cfacda8-cf1f-48e5-8cdb-fb43658b22ee', '464a1f9f-edfc-47d7-951f-116b950af151', 'b4046c8b-35da-4f12-8b03-4191bd168b78'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:42 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:42 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:42 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.302s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:42 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Deleted volume successfully. Aug 28 20:17:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1555c3fd-894c-4629-88e3-9547fc05e769 tempest-VolumesListAdminTestJSON-1300312622 None] Lock "cinder-5450bb5a-1729-4785-a346-b8cc4fa84c7e-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:43 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:17:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Flow 'volume_create_manager' (855e870d-960a-45a1-b09c-52c2c126416b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f11b9e-e77c-4b53-99c9-5935ce1af29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f11b9e-e77c-4b53-99c9-5935ce1af29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1303970079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171f2143-b930-4670-a4cd-0915c1ed091d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d825cd28b2034c26975206ca1fec67e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:44Z,use_quota=True,user_id='8991fcd975124142867247466e464b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40751ac5-9dcf-4eac-8e77-33d54895c2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40751ac5-9dcf-4eac-8e77-33d54895c2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d3a0f0-aa24-4d80-acc4-2e0777301941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d3a0f0-aa24-4d80-acc4-2e0777301941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171f2143-b930-4670-a4cd-0915c1ed091d', 'volume_name': 'volume-171f2143-b930-4670-a4cd-0915c1ed091d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcc4fc0-a9dd-4b94-945b-59b7bb9ab2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdcc4fc0-a9dd-4b94-945b-59b7bb9ab2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c66ffd-3fd9-459d-9135-2d18b7297725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:44 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Volume 171f2143-b930-4670-a4cd-0915c1ed091d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171f2143-b930-4670-a4cd-0915c1ed091d', 'volume_size': 1} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1303970079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171f2143-b930-4670-a4cd-0915c1ed091d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d825cd28b2034c26975206ca1fec67e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:44Z,use_quota=True,user_id='8991fcd975124142867247466e464b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Creating volume 171f2143-b930-4670-a4cd-0915c1ed091d {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:17:44 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:44 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d 1073741824 Aug 28 20:17:44 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:44 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d 1073741824" returned: 0 in 0.675s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:44 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d Aug 28 20:17:44 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:45 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d" returned: 0 in 0.341s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:17:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c66ffd-3fd9-459d-9135-2d18b7297725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171f2143-b930-4670-a4cd-0915c1ed091d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f89203-e24b-477e-b55a-74592b6da07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:45 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Volume volume-171f2143-b930-4670-a4cd-0915c1ed091d (171f2143-b930-4670-a4cd-0915c1ed091d): created successfully Aug 28 20:17:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f89203-e24b-477e-b55a-74592b6da07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Flow 'volume_create_manager' (855e870d-960a-45a1-b09c-52c2c126416b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b7c94607-9214-4a74-81e3-04d508801481 tempest-ServersNegativeTestJSON-1714843588 None] Created volume successfully. Aug 28 20:17:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Acquiring lock "cinder-171f2143-b930-4670-a4cd-0915c1ed091d-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Lock "cinder-171f2143-b930-4670-a4cd-0915c1ed091d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Acquiring lock "cinder-quobyte-171f2143-b930-4670-a4cd-0915c1ed091d" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Lock "cinder-quobyte-171f2143-b930-4670-a4cd-0915c1ed091d" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:47 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebbaf0c-8ae4-4fe7-9c52-5c9e3353b836]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:47 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d Aug 28 20:17:47 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:47 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d" returned: 0 in 0.436s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:47 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d Aug 28 20:17:47 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:48 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-171f2143-b930-4670-a4cd-0915c1ed091d" returned: 0 in 0.386s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Lock "cinder-quobyte-171f2143-b930-4670-a4cd-0915c1ed091d" released by "delete_volume" :: held 0.871s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Created reservations ['bc7edd50-4009-43c5-93fd-48fe5567cedf', '721107af-2771-4b52-8bdb-75f006b240bb', '4264903f-e490-4051-aef3-f7b24146df29', 'ee53600b-b50d-4099-ac79-af3d90e22631'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:48 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:48 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Acquiring lock "cinder-70c572a0-0e53-4014-b974-3b85298d2789-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Lock "cinder-70c572a0-0e53-4014-b974-3b85298d2789-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Acquiring lock "cinder-quobyte-70c572a0-0e53-4014-b974-3b85298d2789" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Lock "cinder-quobyte-70c572a0-0e53-4014-b974-3b85298d2789" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[14648be6-9184-451c-a70e-0e081e5e59a2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:48 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.475s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:48 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789 Aug 28 20:17:48 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Deleted volume successfully. Aug 28 20:17:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb88dafd-f142-4059-bd0e-d6fbae3a7911 tempest-ServersNegativeTestJSON-1714843588 None] Lock "cinder-171f2143-b930-4670-a4cd-0915c1ed091d-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:49 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789" returned: 0 in 0.504s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:49 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789 Aug 28 20:17:49 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:49 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-70c572a0-0e53-4014-b974-3b85298d2789" returned: 0 in 0.338s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Lock "cinder-quobyte-70c572a0-0e53-4014-b974-3b85298d2789" released by "delete_volume" :: held 0.942s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Flow 'volume_create_manager' (d1339b45-adc9-4a20-bdbd-9f07f423e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc6bc10-1e6f-4f59-9a95-0712244a0ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Created reservations ['a3bd421e-9d6c-4273-89ee-28b3555b70dd', 'c0d84e61-47aa-4b74-9a6c-6607e134d47a', 'c0c574c6-1e41-46ee-9b0f-03624eb95c8d', 'd508ba07-014e-44dd-9a4b-1f820b85283a'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc6bc10-1e6f-4f59-9a95-0712244a0ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1815875972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e91e9d2-6124-445b-b063-475d85b1cfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4910addfc64322b5cbb6f690b9cf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:49Z,use_quota=True,user_id='9c7f5eb25d7241b394911538804c8875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33cd93f-0687-4ebb-85d4-2f3f81f01f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33cd93f-0687-4ebb-85d4-2f3f81f01f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f3d255-275a-4a37-8afa-deed0ee68d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f3d255-275a-4a37-8afa-deed0ee68d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e91e9d2-6124-445b-b063-475d85b1cfc1', 'volume_name': 'volume-0e91e9d2-6124-445b-b063-475d85b1cfc1', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984ac721-b356-4820-87bd-3f16e40a7f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984ac721-b356-4820-87bd-3f16e40a7f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56dad97-75ac-4539-a8fe-82c65c8ba23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:49 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Volume 0e91e9d2-6124-445b-b063-475d85b1cfc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e91e9d2-6124-445b-b063-475d85b1cfc1', 'volume_size': 1} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1815875972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e91e9d2-6124-445b-b063-475d85b1cfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4910addfc64322b5cbb6f690b9cf7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:49Z,use_quota=True,user_id='9c7f5eb25d7241b394911538804c8875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Creating volume 0e91e9d2-6124-445b-b063-475d85b1cfc1 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:17:49 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:49 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 1073741824 Aug 28 20:17:49 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:49 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:49 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:50 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.332s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Deleted volume successfully. Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-925dc809-4fe9-4d7f-bee4-dbd8ad6da4a3 tempest-ServersNegativeTestJSON-1714843588 None] Lock "cinder-70c572a0-0e53-4014-b974-3b85298d2789-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:50 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 1073741824" returned: 0 in 0.535s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:50 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 Aug 28 20:17:50 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:50 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1" returned: 0 in 0.299s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56dad97-75ac-4539-a8fe-82c65c8ba23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e91e9d2-6124-445b-b063-475d85b1cfc1', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e002df-912c-4e46-b3a3-7a2f01f4ddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:50 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Volume volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 (0e91e9d2-6124-445b-b063-475d85b1cfc1): created successfully Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e002df-912c-4e46-b3a3-7a2f01f4ddda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Flow 'volume_create_manager' (d1339b45-adc9-4a20-bdbd-9f07f423e301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7c63696b-3d31-4b65-adcc-239caccdbecf tempest-SnapshotMetadataTestJSON-988746784 None] Created volume successfully. Aug 28 20:17:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Creating offline snapshot 9bc6c5f2-bf23-4036-8897-f3777f50cdba of volume 0e91e9d2-6124-445b-b063-475d85b1cfc1 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:17:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[988e8efc-ec58-4768-9f6d-0f6938a1e4ed]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:52 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 Aug 28 20:17:52 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:52 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1" returned: 0 in 0.552s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:52 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba 1G Aug 28 20:17:52 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5d6ab9e4-0557-4453-91c6-b88d2e1f215e tempest-GroupSnapshotsTest-399105792 None] Group tempest-GroupSnapshotsTest-Group-132499701: creating Aug 28 20:17:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5d6ab9e4-0557-4453-91c6-b88d2e1f215e tempest-GroupSnapshotsTest-399105792 None] Group tempest-GroupSnapshotsTest-Group-132499701: created successfully Aug 28 20:17:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5d6ab9e4-0557-4453-91c6-b88d2e1f215e tempest-GroupSnapshotsTest-399105792 None] Create group completed successfully. Aug 28 20:17:53 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba 1G" returned: 0 in 0.585s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:53 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba Aug 28 20:17:53 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:53 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba" returned: 0 in 0.313s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:53 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba is being set with open permissions: ugo+rw Aug 28 20:17:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:53 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba Aug 28 20:17:53 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:53 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba" returned: 0 in 0.269s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:53 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.info Aug 28 20:17:53 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:53 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.info" returned: 0 in 0.292s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:53 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.info is being set with open permissions: ugo+rw Aug 28 20:17:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:54 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.info Aug 28 20:17:54 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:54 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.info" returned: 0 in 0.381s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6cb23e96-2cca-4b52-b6a8-783f8f0eaebd tempest-SnapshotMetadataTestJSON-988746784 None] Create snapshot completed successfully Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Flow 'volume_create_manager' (66bff7f6-010d-4be8-a38c-d30bca183bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a68509-12ed-4ff6-a070-653bda5d3f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a68509-12ed-4ff6-a070-653bda5d3f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1547441829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06e7708b-8757-40d6-89df-f127ee9dbd9a,host='devstack@QuobyteHD#QuobyteHD',id=407ae815-70d1-4611-97f7-fc34f45691d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7146a4dfd44723bfd88ceca25fb7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:55Z,use_quota=True,user_id='43eeeb0889fb4f94acb5fd086814a35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7d35fc8-945b-4ee5-be37-a89a8ec6cf16),volume_type_id=f7d35fc8-945b-4ee5-be37-a89a8ec6cf16)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f892964-a3e2-42b8-95dd-ad5cec7a44f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f892964-a3e2-42b8-95dd-ad5cec7a44f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37944c59-3bbb-467b-8453-17cf311eedeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37944c59-3bbb-467b-8453-17cf311eedeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407ae815-70d1-4611-97f7-fc34f45691d6', 'volume_name': 'volume-407ae815-70d1-4611-97f7-fc34f45691d6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f71e3f-11d1-4d80-94dd-b18282a0cf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f71e3f-11d1-4d80-94dd-b18282a0cf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5022feb0-b4a0-44ec-9d7b-97eaa4c107c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:54 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Volume 407ae815-70d1-4611-97f7-fc34f45691d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407ae815-70d1-4611-97f7-fc34f45691d6', 'volume_size': 1} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06e7708b-8757-40d6-89df-f127ee9dbd9a,created_at=2026-08-28T18:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1547441829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06e7708b-8757-40d6-89df-f127ee9dbd9a,host='devstack@QuobyteHD#QuobyteHD',id=407ae815-70d1-4611-97f7-fc34f45691d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7146a4dfd44723bfd88ceca25fb7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:17:55Z,use_quota=True,user_id='43eeeb0889fb4f94acb5fd086814a35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7d35fc8-945b-4ee5-be37-a89a8ec6cf16),volume_type_id=f7d35fc8-945b-4ee5-be37-a89a8ec6cf16)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Creating volume 407ae815-70d1-4611-97f7-fc34f45691d6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:17:54 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:17:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:54 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 1073741824 Aug 28 20:17:54 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:55 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 1073741824" returned: 0 in 0.650s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:55 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 Aug 28 20:17:55 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:55 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6" returned: 0 in 0.344s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5022feb0-b4a0-44ec-9d7b-97eaa4c107c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407ae815-70d1-4611-97f7-fc34f45691d6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7408c62-a84b-408f-a70d-fa0ac9c4c2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Acquiring lock "cinder-9bc6c5f2-bf23-4036-8897-f3777f50cdba-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:55 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Volume volume-407ae815-70d1-4611-97f7-fc34f45691d6 (407ae815-70d1-4611-97f7-fc34f45691d6): created successfully Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7408c62-a84b-408f-a70d-fa0ac9c4c2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Flow 'volume_create_manager' (66bff7f6-010d-4be8-a38c-d30bca183bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Lock "cinder-9bc6c5f2-bf23-4036-8897-f3777f50cdba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Acquiring lock "cinder-quobyte-0e91e9d2-6124-445b-b063-475d85b1cfc1" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3bc17b85-9e42-45f7-80d0-401f4e3d8d03 tempest-GroupSnapshotsTest-399105792 None] Created volume successfully. Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Lock "cinder-quobyte-0e91e9d2-6124-445b-b063-475d85b1cfc1" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Acquiring lock "cinder-quobyte-9bc6c5f2-bf23-4036-8897-f3777f50cdba" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Lock "cinder-quobyte-9bc6c5f2-bf23-4036-8897-f3777f50cdba" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Deleting offline snapshot 9bc6c5f2-bf23-4036-8897-f3777f50cdba of volume 0e91e9d2-6124-445b-b063-475d85b1cfc1 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] snapshot_file for this snap is: volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[56401639-e545-493c-87d6-9d38dd09dcb8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:56 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba Aug 28 20:17:56 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:56 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba" returned: 0 in 0.419s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e91e9d2-6124-445b-b063-475d85b1cfc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06400df-8f66-4593-b93f-ef3f742c80ed]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:56 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 Aug 28 20:17:56 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:56 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1" returned: 0 in 0.375s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:56 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba Aug 28 20:17:56 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:57 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba" returned: 0 in 0.458s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:57 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba Aug 28 20:17:57 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] GroupSnapshot cb3fac21-f5f0-4362-b07a-031853ed9b9b: creating. Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Group snapshot cb3fac21-f5f0-4362-b07a-031853ed9b9b: creating. {{(pid=86028) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Creating offline snapshot a87f7d6d-27ca-43a5-bafb-bfea6e40a594 of volume 407ae815-70d1-4611-97f7-fc34f45691d6 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:17:57 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1.9bc6c5f2-bf23-4036-8897-f3777f50cdba" returned: 0 in 0.327s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d64e05-fd3d-47a5-890e-44b3aef36e94]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Lock "cinder-quobyte-9bc6c5f2-bf23-4036-8897-f3777f50cdba" released by "_delete_snapshot" :: held 1.721s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Lock "cinder-quobyte-0e91e9d2-6124-445b-b063-475d85b1cfc1" released by "delete_snapshot" :: held 1.757s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Created reservations ['3f549a6e-6061-4b37-b697-f44191eee4a9', 'bc022a07-7d7c-4ef2-95b7-dd2846872256', 'bfd40e4b-04a4-4623-b7bc-84e603c4048c', 'edac35b8-972a-42f1-bd24-f84ad7561232'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:57 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 Aug 28 20:17:57 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Delete snapshot completed successfully. Aug 28 20:17:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9641479c-5e89-4066-a348-33fbd47aec4a tempest-SnapshotMetadataTestJSON-988746784 None] Lock "cinder-9bc6c5f2-bf23-4036-8897-f3777f50cdba-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:58 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6" returned: 0 in 0.382s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:58 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 1G Aug 28 20:17:58 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Acquiring lock "cinder-0e91e9d2-6124-445b-b063-475d85b1cfc1-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Lock "cinder-0e91e9d2-6124-445b-b063-475d85b1cfc1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Acquiring lock "cinder-quobyte-0e91e9d2-6124-445b-b063-475d85b1cfc1" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Lock "cinder-quobyte-0e91e9d2-6124-445b-b063-475d85b1cfc1" acquired by "delete_volume" :: waited 0.037s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0607071f-ff27-4aa9-93c3-9df575f022c0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:58 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 Aug 28 20:17:58 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:58 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 1G" returned: 0 in 0.725s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407ae815-70d1-4611-97f7-fc34f45691d6 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:58 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407ae815-70d1-4611-97f7-fc34f45691d6 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 Aug 28 20:17:58 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:58 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1" returned: 0 in 0.538s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:59 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1 Aug 28 20:17:59 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:59 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-407ae815-70d1-4611-97f7-fc34f45691d6 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594" returned: 0 in 0.361s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:59 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:59 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 Aug 28 20:17:59 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:59 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0e91e9d2-6124-445b-b063-475d85b1cfc1" returned: 0 in 0.322s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Lock "cinder-quobyte-0e91e9d2-6124-445b-b063-475d85b1cfc1" released by "delete_volume" :: held 0.961s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Created reservations ['cbaf0a16-aec8-4378-bef5-877ce318f9aa', '2fb10f3b-4652-466c-b88e-7aa86fd2d919', '06d42581-48aa-45d3-a535-1afa33484003', '03177af2-c264-4436-b050-1cd3810ad0b3'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:59 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594" returned: 0 in 0.351s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:59 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:17:59 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:17:59 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.info Aug 28 20:17:59 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:17:59 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.349s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:17:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Deleted volume successfully. Aug 28 20:17:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-000365c9-63b8-4318-b6d1-004e35b3dab2 tempest-SnapshotMetadataTestJSON-988746784 None] Lock "cinder-0e91e9d2-6124-445b-b063-475d85b1cfc1-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:00 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.info" returned: 0 in 0.459s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:00 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:18:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:00 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.info Aug 28 20:18:00 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:00 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.info" returned: 0 in 0.264s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:00 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2523629b-99ee-4ea1-94bf-988230b0ebb4 tempest-GroupSnapshotsTest-399105792 None] group_snapshot cb3fac21-f5f0-4362-b07a-031853ed9b9b: created successfully Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-a87f7d6d-27ca-43a5-bafb-bfea6e40a594-d8d02226-86b0-46ea-9b5e-eb91b868dd25" by "_create_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-a87f7d6d-27ca-43a5-bafb-bfea6e40a594-d8d02226-86b0-46ea-9b5e-eb91b868dd25" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Creating volume d8d02226-86b0-46ea-9b5e-eb91b868dd25 from snapshot a87f7d6d-27ca-43a5-bafb-bfea6e40a594 {{(pid=86028) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-d8d02226-86b0-46ea-9b5e-eb91b868dd25" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-d8d02226-86b0-46ea-9b5e-eb91b868dd25" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] snapshot: a87f7d6d-27ca-43a5-bafb-bfea6e40a594, volume: d8d02226-86b0-46ea-9b5e-eb91b868dd25, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c926ee-f3db-4698-ac4a-f8298bbf4370]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:02 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 Aug 28 20:18:02 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:02 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594" returned: 0 in 0.544s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-407ae815-70d1-4611-97f7-fc34f45691d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e204067b-b625-4e33-ae11-efe594cac673]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:02 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 Aug 28 20:18:02 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:02 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6" returned: 0 in 0.442s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:18:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:18:02 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:18:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:02 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 Aug 28 20:18:02 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Flow 'volume_create_manager' (2bc44b23-721e-49dc-aaf0-c14ecdcb4185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4406f3b-b75c-4138-beb0-f55d3d444751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4406f3b-b75c-4138-beb0-f55d3d444751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2004262523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8208436c-cd73-4391-88b5-0fd5b5867178,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='199cc6a0ae994d43a5220cf7d03cab84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:06Z,use_quota=True,user_id='2afa445861ac41dc8eb65eb01777c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9137ee4-c1d1-4868-b003-0e6b5d48a0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9137ee4-c1d1-4868-b003-0e6b5d48a0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5512e2-b44b-47e4-ab24-4542f8b7aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5512e2-b44b-47e4-ab24-4542f8b7aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8208436c-cd73-4391-88b5-0fd5b5867178', 'volume_name': 'volume-8208436c-cd73-4391-88b5-0fd5b5867178', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526aa520-3df9-4a8b-91a7-72a43408f8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526aa520-3df9-4a8b-91a7-72a43408f8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e1b5d5-1689-424f-a82b-6b82131fbbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:06 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Volume 8208436c-cd73-4391-88b5-0fd5b5867178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8208436c-cd73-4391-88b5-0fd5b5867178', 'volume_size': 1} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:06 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:18:06 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:07 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.609s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:18:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:18:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:18:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:18:09 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25" returned: 0 in 6.304s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:18:09 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Converted 1024.00 MB image at 162.42 MB/s Aug 28 20:18:09 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:09 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 Aug 28 20:18:09 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:09 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25" returned: 0 in 0.279s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-d8d02226-86b0-46ea-9b5e-eb91b868dd25" released by "_copy_volume_from_snapshot" :: held 7.701s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-a87f7d6d-27ca-43a5-bafb-bfea6e40a594-d8d02226-86b0-46ea-9b5e-eb91b868dd25" released by "_create_volume_from_snapshot" :: held 7.782s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.811s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.255s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2004262523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8208436c-cd73-4391-88b5-0fd5b5867178,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='199cc6a0ae994d43a5220cf7d03cab84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:06Z,use_quota=True,user_id='2afa445861ac41dc8eb65eb01777c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Creating volume 8208436c-cd73-4391-88b5-0fd5b5867178 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:18:09 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:18:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:09 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178 1073741824 Aug 28 20:18:09 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:09 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b285ce30-689a-446b-841c-62b509b77cdb tempest-GroupSnapshotsTest-399105792 None] Create group from source-snapshot-cb3fac21-f5f0-4362-b07a-031853ed9b9b completed successfully. Aug 28 20:18:10 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178 1073741824" returned: 0 in 0.612s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:10 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178 Aug 28 20:18:10 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:10 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178" returned: 0 in 0.387s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06e1b5d5-1689-424f-a82b-6b82131fbbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8208436c-cd73-4391-88b5-0fd5b5867178', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a4c0ff-2cdb-4b5d-99c2-832a60649cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:10 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Volume volume-8208436c-cd73-4391-88b5-0fd5b5867178 (8208436c-cd73-4391-88b5-0fd5b5867178): created successfully Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a4c0ff-2cdb-4b5d-99c2-832a60649cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Flow 'volume_create_manager' (2bc44b23-721e-49dc-aaf0-c14ecdcb4185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:10 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-82935d57-c75c-4007-9db9-9f1702e94aca tempest-VolumesListTestJSON-1602745343 None] Created volume successfully. Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-d8d02226-86b0-46ea-9b5e-eb91b868dd25" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-d8d02226-86b0-46ea-9b5e-eb91b868dd25" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[234c6470-5292-4c55-84f0-f18d2f71e9aa]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:11 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 Aug 28 20:18:11 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:11 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25" returned: 0 in 0.469s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:11 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25 Aug 28 20:18:11 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:11 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d8d02226-86b0-46ea-9b5e-eb91b868dd25" returned: 0 in 0.316s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-d8d02226-86b0-46ea-9b5e-eb91b868dd25" released by "delete_volume" :: held 0.841s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:11 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['542f1ace-f5a4-4add-af21-7572207c7642'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:11 devstack cinder-volume[86028]: WARNING cinder.quota [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1699809741 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1699809741, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:18:11 devstack cinder-volume[86028]: WARNING cinder.quota [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1699809741 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1699809741, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:18:11 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['b4b1582c-ed04-419b-8f98-353069fe4269', 'd7d41d0b-a97c-4682-800b-951166e6b007', 'da078a9b-0745-4b82-b68d-fa91a8407437', '2fb2fffe-13e9-49aa-8135-80b40876530c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:12 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:18:12 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:12 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] group_snapshot cb3fac21-f5f0-4362-b07a-031853ed9b9b: deleting Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] group_snapshot cb3fac21-f5f0-4362-b07a-031853ed9b9b: deleting {{(pid=86028) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-407ae815-70d1-4611-97f7-fc34f45691d6" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-407ae815-70d1-4611-97f7-fc34f45691d6" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-a87f7d6d-27ca-43a5-bafb-bfea6e40a594" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-a87f7d6d-27ca-43a5-bafb-bfea6e40a594" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Deleting offline snapshot a87f7d6d-27ca-43a5-bafb-bfea6e40a594 of volume 407ae815-70d1-4611-97f7-fc34f45691d6 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] snapshot_file for this snap is: volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee28f8cb-a46b-4f8e-8f8d-cbb5b76ffba7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Flow 'volume_create_manager' (b8706b50-3f46-4b8e-ba2e-cccba525e990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46da773a-a741-487d-95f7-efebea68bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:12 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.622s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46da773a-a741-487d-95f7-efebea68bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-502008748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24d5202-f8d6-4918-b2d6-55dcea8cb9c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='199cc6a0ae994d43a5220cf7d03cab84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:12Z,use_quota=True,user_id='2afa445861ac41dc8eb65eb01777c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede62df6-d1be-49cd-bcad-636bd05c8fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede62df6-d1be-49cd-bcad-636bd05c8fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35d53c8-0eaf-477f-a3bf-92bbafa8c881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35d53c8-0eaf-477f-a3bf-92bbafa8c881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24d5202-f8d6-4918-b2d6-55dcea8cb9c6', 'volume_name': 'volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1d7386-8aa9-4b68-9e1a-a0fc369e8296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1d7386-8aa9-4b68-9e1a-a0fc369e8296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc96488-f9fe-40c8-ac87-8281d6e700ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:12 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Volume c24d5202-f8d6-4918-b2d6-55dcea8cb9c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6', 'volume_size': 1} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-502008748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24d5202-f8d6-4918-b2d6-55dcea8cb9c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='199cc6a0ae994d43a5220cf7d03cab84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:12Z,use_quota=True,user_id='2afa445861ac41dc8eb65eb01777c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Creating volume c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:18:12 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:18:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:12 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-27418171-28d9-4602-a040-6da2821bb3f3 tempest-GroupSnapshotsTest-399105792 None] Delete group completed successfully. Aug 28 20:18:12 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 Aug 28 20:18:12 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:12 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 1073741824 Aug 28 20:18:12 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:13 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594" returned: 0 in 0.522s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-407ae815-70d1-4611-97f7-fc34f45691d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cdb79a-4d1c-4f8e-a5be-b5f5b7afb08c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:13 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 Aug 28 20:18:13 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:13 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 1073741824" returned: 0 in 0.664s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:13 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 Aug 28 20:18:13 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:13 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6" returned: 0 in 0.299s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc96488-f9fe-40c8-ac87-8281d6e700ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2caaab2f-44b0-46b4-a3b2-550f537d9ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:13 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Volume volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 (c24d5202-f8d6-4918-b2d6-55dcea8cb9c6): created successfully Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2caaab2f-44b0-46b4-a3b2-550f537d9ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Flow 'volume_create_manager' (b8706b50-3f46-4b8e-ba2e-cccba525e990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:13 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-89ad366c-259d-4609-93b4-06475ba6cc57 tempest-VolumesListTestJSON-1602745343 None] Created volume successfully. Aug 28 20:18:13 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6" returned: 0 in 0.829s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:13 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 Aug 28 20:18:13 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:14 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594" returned: 0 in 0.369s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:14 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594 Aug 28 20:18:14 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:14 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6.a87f7d6d-27ca-43a5-bafb-bfea6e40a594" returned: 0 in 0.404s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-a87f7d6d-27ca-43a5-bafb-bfea6e40a594" released by "_delete_snapshot" :: held 2.307s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-407ae815-70d1-4611-97f7-fc34f45691d6" released by "delete_snapshot" :: held 2.358s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:14 devstack cinder-volume[86028]: WARNING cinder.quota [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1699809741 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1699809741, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:18:14 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['93d1efe0-fbc0-407c-b063-0d757195d376', '05002dc2-b823-42b6-9f6f-41aeb2fcd245', '37a74236-9dc7-4ce4-8869-86bb8c09c88f', 'c1b745f6-e8c9-4d15-aef0-10181e6d741c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:14 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3177f670-2639-40dd-a556-5a0d81cf4ee1 tempest-GroupSnapshotsTest-399105792 None] group_snapshot cb3fac21-f5f0-4362-b07a-031853ed9b9b: deleted successfully Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Flow 'volume_create_manager' (ebe3b1af-249a-4f8d-acd1-8e1ca521dcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac024f04-afa9-4094-8012-818a55871490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac024f04-afa9-4094-8012-818a55871490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-159348305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9260fc20-1f42-4376-a939-9f51bba24ede,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='199cc6a0ae994d43a5220cf7d03cab84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:15Z,use_quota=True,user_id='2afa445861ac41dc8eb65eb01777c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8749686-85d8-46f6-8b9c-05a99403d436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8749686-85d8-46f6-8b9c-05a99403d436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5aed11-5c63-4883-8fdb-3fb5b898a80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5aed11-5c63-4883-8fdb-3fb5b898a80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9260fc20-1f42-4376-a939-9f51bba24ede', 'volume_name': 'volume-9260fc20-1f42-4376-a939-9f51bba24ede', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1b743b-dddd-47a2-83e6-3584c5b99b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1b743b-dddd-47a2-83e6-3584c5b99b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36312bd-6bce-4e8b-85e3-59870956f63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:15 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Volume 9260fc20-1f42-4376-a939-9f51bba24ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9260fc20-1f42-4376-a939-9f51bba24ede', 'volume_size': 1} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-159348305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9260fc20-1f42-4376-a939-9f51bba24ede,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='199cc6a0ae994d43a5220cf7d03cab84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:15Z,use_quota=True,user_id='2afa445861ac41dc8eb65eb01777c0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Creating volume 9260fc20-1f42-4376-a939-9f51bba24ede {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:18:15 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:15 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede 1073741824 Aug 28 20:18:15 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:15 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede 1073741824" returned: 0 in 0.557s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:16 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede Aug 28 20:18:16 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-407ae815-70d1-4611-97f7-fc34f45691d6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-407ae815-70d1-4611-97f7-fc34f45691d6" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:16 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede" returned: 0 in 0.364s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e36312bd-6bce-4e8b-85e3-59870956f63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9260fc20-1f42-4376-a939-9f51bba24ede', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1aed91-1f63-474a-a62c-6f11fa1a9e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[71567a16-9cfc-4293-abcf-8cb68b1938bb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:16 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Volume volume-9260fc20-1f42-4376-a939-9f51bba24ede (9260fc20-1f42-4376-a939-9f51bba24ede): created successfully Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1aed91-1f63-474a-a62c-6f11fa1a9e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Flow 'volume_create_manager' (ebe3b1af-249a-4f8d-acd1-8e1ca521dcd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-11a4c9a4-14f1-4364-a312-0eb5bd5969d0 tempest-VolumesListTestJSON-1602745343 None] Created volume successfully. Aug 28 20:18:16 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 Aug 28 20:18:16 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:16 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6" returned: 0 in 0.429s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:16 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6 Aug 28 20:18:16 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:17 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-407ae815-70d1-4611-97f7-fc34f45691d6" returned: 0 in 0.253s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-407ae815-70d1-4611-97f7-fc34f45691d6" released by "delete_volume" :: held 0.770s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['54c681d1-eb2a-4d75-9233-6210e83eebbf'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:17 devstack cinder-volume[86028]: WARNING cinder.db.api [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1699809741'] Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['afeb0d55-ea3f-4744-95c0-9e4cd86e3dbd', '9b40e269-c434-4105-b710-61df41734bbc', 'ded98d34-b673-4b96-915e-02129696d04c', '75858e4b-c3b8-467a-becf-21e4473bded3'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:17 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:18:17 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:17 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.506s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:17 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:18:17 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-aee7d1b9-bcc2-4aca-93e1-782cd9a4a339 tempest-GroupSnapshotsTest-399105792 None] Delete group completed successfully. Aug 28 20:18:18 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e001d62c-d2c7-451c-8848-f2b300f4462b tempest-GroupSnapshotsTest-399105792 None] Group tempest-GroupSnapshotsTest-Group-1529302711: creating Aug 28 20:18:18 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e001d62c-d2c7-451c-8848-f2b300f4462b tempest-GroupSnapshotsTest-399105792 None] Group tempest-GroupSnapshotsTest-Group-1529302711: created successfully Aug 28 20:18:18 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e001d62c-d2c7-451c-8848-f2b300f4462b tempest-GroupSnapshotsTest-399105792 None] Create group completed successfully. Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "cinder-9260fc20-1f42-4376-a939-9f51bba24ede-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Flow 'volume_create_manager' (b7f7cf3e-333b-45ca-a7fe-6f14bc64d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cd230c-9be7-4fb9-9554-9c163df62e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-9260fc20-1f42-4376-a939-9f51bba24ede-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cd230c-9be7-4fb9-9554-9c163df62e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-762202897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03aa2958-c16e-4318-9d13-d7a3890c38b8,host='devstack@QuobyteHD#QuobyteHD',id=5517e3de-0195-408d-a17b-5a9fecd7005a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7146a4dfd44723bfd88ceca25fb7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:20Z,use_quota=True,user_id='43eeeb0889fb4f94acb5fd086814a35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913158f7-f7ee-4647-8f7c-fd9db64c1353),volume_type_id=913158f7-f7ee-4647-8f7c-fd9db64c1353)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce1ad16-ff56-4488-817e-c3d572371bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce1ad16-ff56-4488-817e-c3d572371bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0c2b1-c9c1-4774-bf63-294cd7b45d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0c2b1-c9c1-4774-bf63-294cd7b45d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5517e3de-0195-408d-a17b-5a9fecd7005a', 'volume_name': 'volume-5517e3de-0195-408d-a17b-5a9fecd7005a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff56a073-db2a-41f6-83f0-a19ff6b4d5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff56a073-db2a-41f6-83f0-a19ff6b4d5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6fab8b-cedb-4d4c-b74b-668be6bd885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:20 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Volume 5517e3de-0195-408d-a17b-5a9fecd7005a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5517e3de-0195-408d-a17b-5a9fecd7005a', 'volume_size': 1} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03aa2958-c16e-4318-9d13-d7a3890c38b8,created_at=2026-08-28T18:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-762202897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03aa2958-c16e-4318-9d13-d7a3890c38b8,host='devstack@QuobyteHD#QuobyteHD',id=5517e3de-0195-408d-a17b-5a9fecd7005a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7146a4dfd44723bfd88ceca25fb7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:20Z,use_quota=True,user_id='43eeeb0889fb4f94acb5fd086814a35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913158f7-f7ee-4647-8f7c-fd9db64c1353),volume_type_id=913158f7-f7ee-4647-8f7c-fd9db64c1353)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Creating volume 5517e3de-0195-408d-a17b-5a9fecd7005a {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:18:20 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:20 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a 1073741824 Aug 28 20:18:20 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "cinder-quobyte-9260fc20-1f42-4376-a939-9f51bba24ede" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-quobyte-9260fc20-1f42-4376-a939-9f51bba24ede" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff4374b-28a0-4b23-8d80-763ba2e70d99]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:20 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede Aug 28 20:18:20 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:21 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a 1073741824" returned: 0 in 0.611s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:21 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede" returned: 0 in 0.568s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:21 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a Aug 28 20:18:21 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:21 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede Aug 28 20:18:21 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:21 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a" returned: 0 in 0.424s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6fab8b-cedb-4d4c-b74b-668be6bd885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5517e3de-0195-408d-a17b-5a9fecd7005a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc4b43e-1176-4442-9f1a-7469f4e2a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:21 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9260fc20-1f42-4376-a939-9f51bba24ede" returned: 0 in 0.438s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:21 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Volume volume-5517e3de-0195-408d-a17b-5a9fecd7005a (5517e3de-0195-408d-a17b-5a9fecd7005a): created successfully Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc4b43e-1176-4442-9f1a-7469f4e2a277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Flow 'volume_create_manager' (b7f7cf3e-333b-45ca-a7fe-6f14bc64d00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-quobyte-9260fc20-1f42-4376-a939-9f51bba24ede" released by "delete_volume" :: held 1.089s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d9b9a1a0-1143-4ddd-b7c8-4c23f0844b50 tempest-GroupSnapshotsTest-399105792 None] Created volume successfully. Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Created reservations ['d5a834cb-8bfd-4f77-b657-c015da69b8d6', '04a2c439-c8b3-4590-a4fa-0153f3ec2569', '866f25d1-a879-4b10-bb98-02fda20cf119', 'feabdbb5-291f-4ca2-9709-80a6f6d222e5'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:21 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:18:21 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:21 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.272s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:22 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:18:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Deleted volume successfully. Aug 28 20:18:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5f439d1-6474-4450-acb1-acbc4fcc4d74 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-9260fc20-1f42-4376-a939-9f51bba24ede-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "cinder-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "cinder-quobyte-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-quobyte-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6" acquired by "delete_volume" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:22 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc0e849-2f5e-46ac-880a-15de3e2998c9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:23 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 Aug 28 20:18:23 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:23 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6" returned: 0 in 0.623s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:23 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6 Aug 28 20:18:23 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Flow 'volume_create_manager' (2fc96983-ff5b-4acb-a008-ff55fc1df09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93016299-de45-4a17-a5c0-42a5838a43a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93016299-de45-4a17-a5c0-42a5838a43a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1423567706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03aa2958-c16e-4318-9d13-d7a3890c38b8,host='devstack@QuobyteHD#QuobyteHD',id=5fffb3b0-af86-4580-9453-796e27d01f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7146a4dfd44723bfd88ceca25fb7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:24Z,use_quota=True,user_id='43eeeb0889fb4f94acb5fd086814a35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913158f7-f7ee-4647-8f7c-fd9db64c1353),volume_type_id=913158f7-f7ee-4647-8f7c-fd9db64c1353)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4dc963-7203-4dd9-affc-01bc9686976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4dc963-7203-4dd9-affc-01bc9686976d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f185d987-f214-4ce3-a1b5-ba0f4c795031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f185d987-f214-4ce3-a1b5-ba0f4c795031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fffb3b0-af86-4580-9453-796e27d01f69', 'volume_name': 'volume-5fffb3b0-af86-4580-9453-796e27d01f69', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69dee50c-7151-4360-8657-ecf6a7c612f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69dee50c-7151-4360-8657-ecf6a7c612f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d8650e-3fe0-463c-80be-c451dffb5ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:23 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Volume 5fffb3b0-af86-4580-9453-796e27d01f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fffb3b0-af86-4580-9453-796e27d01f69', 'volume_size': 1} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03aa2958-c16e-4318-9d13-d7a3890c38b8,created_at=2026-08-28T18:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1423567706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03aa2958-c16e-4318-9d13-d7a3890c38b8,host='devstack@QuobyteHD#QuobyteHD',id=5fffb3b0-af86-4580-9453-796e27d01f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7146a4dfd44723bfd88ceca25fb7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:24Z,use_quota=True,user_id='43eeeb0889fb4f94acb5fd086814a35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(913158f7-f7ee-4647-8f7c-fd9db64c1353),volume_type_id=913158f7-f7ee-4647-8f7c-fd9db64c1353)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Creating volume 5fffb3b0-af86-4580-9453-796e27d01f69 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:18:23 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:23 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:23 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 1073741824 Aug 28 20:18:23 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6" returned: 0 in 0.375s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-quobyte-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6" released by "delete_volume" :: held 1.065s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=138,cinder:UPDATE=176,cinder:INSERT=42,cinder:DELETE=13 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Created reservations ['226aca35-c899-4b14-af08-2de0a1c9e104', 'a490f5e8-9daf-4f79-b2ad-01f5c33b22e0', '2955975a-1acf-4d0a-b12b-cadb8032b378', 'fafa8814-071f-4638-8917-0910418a1049'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=174,cinder:SELECT=135,cinder:INSERT=43,cinder:DELETE=12 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:24 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:18:24 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:24 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:24 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.298s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 1073741824" returned: 0 in 0.610s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Deleted volume successfully. Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-bd0f09e6-e4ca-4b9e-ab92-eb78974a56f6 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-c24d5202-f8d6-4918-b2d6-55dcea8cb9c6-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:24 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 Aug 28 20:18:24 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:24 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69" returned: 0 in 0.304s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d8650e-3fe0-463c-80be-c451dffb5ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fffb3b0-af86-4580-9453-796e27d01f69', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebc07bb-565c-439a-8349-bbebb1445e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:24 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Volume volume-5fffb3b0-af86-4580-9453-796e27d01f69 (5fffb3b0-af86-4580-9453-796e27d01f69): created successfully Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebc07bb-565c-439a-8349-bbebb1445e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Flow 'volume_create_manager' (2fc96983-ff5b-4acb-a008-ff55fc1df09c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4acfffa9-6f31-4f45-98cb-d4d6140deab2 tempest-GroupSnapshotsTest-399105792 None] Created volume successfully. Aug 28 20:18:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "cinder-8208436c-cd73-4391-88b5-0fd5b5867178-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-8208436c-cd73-4391-88b5-0fd5b5867178-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "cinder-quobyte-8208436c-cd73-4391-88b5-0fd5b5867178" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-quobyte-8208436c-cd73-4391-88b5-0fd5b5867178" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f180cc7b-9824-4ba3-bb74-095b96e373f8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:25 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178 Aug 28 20:18:25 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:25 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178" returned: 0 in 0.456s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:25 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178 Aug 28 20:18:25 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:26 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8208436c-cd73-4391-88b5-0fd5b5867178" returned: 0 in 0.330s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-quobyte-8208436c-cd73-4391-88b5-0fd5b5867178" released by "delete_volume" :: held 0.837s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Created reservations ['7729663e-2e74-4787-8cc0-60764f4b6ab8', '6fcae126-24c8-4cae-af48-348b915aafea', '849d791f-1a2c-4ee9-9d8e-78b886c97c78', '801d6497-4970-4190-b194-ab3ab9c47e30'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:26 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:18:26 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:26 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-77ffb3ff-8a9f-4dbb-bc68-dd2dd77f2cba tempest-GroupSnapshotsTest-399105792 None] Update group completed successfully. Aug 28 20:18:26 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.336s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:18:26 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Deleted volume successfully. Aug 28 20:18:26 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a1223d1-ab2d-4105-b766-43bff1aff653 tempest-VolumesListTestJSON-1602745343 None] Lock "cinder-8208436c-cd73-4391-88b5-0fd5b5867178-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-cd32ebad-a444-4941-888d-1f23a51e6e4e tempest-GroupSnapshotsTest-399105792 None] Update group completed successfully. Aug 28 20:18:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-bf4f376e-df18-41d6-98a5-44817dcbc1ec tempest-GroupSnapshotsTest-399105792 None] Update group completed successfully. Aug 28 20:18:30 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7b072060-56a1-4b46-a96c-73bcbb8346e9 tempest-GroupSnapshotsTest-399105792 None] Update group completed successfully. Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Flow 'volume_create_manager' (a93c9cf0-ac60-4672-9b85-93e9c5084517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97f2aa7-66e0-4e22-bb15-dd7988dec4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97f2aa7-66e0-4e22-bb15-dd7988dec4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2139720988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce921e1-b719-4960-b518-3d0d3359433e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68630fe72dc946cba181bffbc070cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:30Z,use_quota=True,user_id='ec8ec7a4e7354fe3a0b6aee5e8567856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b720721c-a2bc-4b85-bf92-fbcf6e403b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b720721c-a2bc-4b85-bf92-fbcf6e403b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4324f00a-cda6-48d3-855f-caf6b5c3ac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4324f00a-cda6-48d3-855f-caf6b5c3ac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce921e1-b719-4960-b518-3d0d3359433e', 'volume_name': 'volume-0ce921e1-b719-4960-b518-3d0d3359433e', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3506ae14-d427-4a84-b594-027e1b4c3588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3506ae14-d427-4a84-b594-027e1b4c3588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce74c3a-b0c8-494e-a8ff-38d74997a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Volume 0ce921e1-b719-4960-b518-3d0d3359433e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce921e1-b719-4960-b518-3d0d3359433e', 'volume_size': 1} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2139720988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce921e1-b719-4960-b518-3d0d3359433e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68630fe72dc946cba181bffbc070cf98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:30Z,use_quota=True,user_id='ec8ec7a4e7354fe3a0b6aee5e8567856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Creating volume 0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:18:30 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:18:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:30 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e 1073741824 Aug 28 20:18:30 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:31 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e 1073741824" returned: 0 in 0.671s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:31 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e Aug 28 20:18:31 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:31 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e" returned: 0 in 0.692s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:18:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce74c3a-b0c8-494e-a8ff-38d74997a397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce921e1-b719-4960-b518-3d0d3359433e', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d56087-f71c-4f38-91ec-0447da4ddd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:32 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Volume volume-0ce921e1-b719-4960-b518-3d0d3359433e (0ce921e1-b719-4960-b518-3d0d3359433e): created successfully Aug 28 20:18:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d56087-f71c-4f38-91ec-0447da4ddd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Flow 'volume_create_manager' (a93c9cf0-ac60-4672-9b85-93e9c5084517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-396b40d9-9509-4f7a-81ff-d3d10d84af94 tempest-VolumesSnapshotListTestJSON-1413039484 None] Created volume successfully. Aug 28 20:18:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] GroupSnapshot bf10c3c3-7c6d-450f-8c97-ddae1595cd72: creating. Aug 28 20:18:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Group snapshot bf10c3c3-7c6d-450f-8c97-ddae1595cd72: creating. {{(pid=86028) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 20:18:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Creating offline snapshot 81abded5-2bc0-469a-a1f8-d5a4de81b624 of volume 5517e3de-0195-408d-a17b-5a9fecd7005a {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:18:32 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14464aa-e5ea-403d-9d09-2f1430c7e875]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:32 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a Aug 28 20:18:32 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:33 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a" returned: 0 in 0.786s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:33 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 1G Aug 28 20:18:33 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:34 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 1G" returned: 0 in 0.684s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5517e3de-0195-408d-a17b-5a9fecd7005a -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:34 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5517e3de-0195-408d-a17b-5a9fecd7005a -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 Aug 28 20:18:34 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:34 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5517e3de-0195-408d-a17b-5a9fecd7005a -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624" returned: 0 in 0.480s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:34 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:18:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:34 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 Aug 28 20:18:34 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:34 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624" returned: 0 in 0.332s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:35 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.info Aug 28 20:18:35 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:35 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.info" returned: 0 in 0.502s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:35 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:18:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:35 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.info Aug 28 20:18:35 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:35 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.info" returned: 0 in 0.411s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.397s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Creating offline snapshot c4bb6d2b-accc-424e-8d94-7cd3c1afa11c of volume 5fffb3b0-af86-4580-9453-796e27d01f69 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:18:36 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ccde97-3381-4208-89df-c9c51d693f11]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:36 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 Aug 28 20:18:36 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:37 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69" returned: 0 in 0.947s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:37 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c 1G Aug 28 20:18:37 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:37 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c 1G" returned: 0 in 0.790s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fffb3b0-af86-4580-9453-796e27d01f69 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:37 devstack sudo[94643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fffb3b0-af86-4580-9453-796e27d01f69 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c Aug 28 20:18:37 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:38 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fffb3b0-af86-4580-9453-796e27d01f69 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c" returned: 0 in 0.377s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:38 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:18:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:38 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c Aug 28 20:18:38 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:38 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c" returned: 0 in 0.320s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:38 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.info Aug 28 20:18:38 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:38 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.info" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:38 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:18:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:39 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.info Aug 28 20:18:39 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:39 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.info" returned: 0 in 0.356s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.392s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.231s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Creating offline snapshot 9591e62e-7480-4fb2-9560-5b31903d11f5 of volume 0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:18:39 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1da6b6c-5643-4005-8ead-4508790488a7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c54241a1-1974-4c49-8ae9-9753401ac598 tempest-GroupSnapshotsTest-399105792 None] group_snapshot bf10c3c3-7c6d-450f-8c97-ddae1595cd72: created successfully Aug 28 20:18:39 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e Aug 28 20:18:39 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:40 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e" returned: 0 in 0.953s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:40 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 1G Aug 28 20:18:40 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] group_snapshot bf10c3c3-7c6d-450f-8c97-ddae1595cd72: deleting Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] group_snapshot bf10c3c3-7c6d-450f-8c97-ddae1595cd72: deleting {{(pid=86028) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-5517e3de-0195-408d-a17b-5a9fecd7005a" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-5517e3de-0195-408d-a17b-5a9fecd7005a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-81abded5-2bc0-469a-a1f8-d5a4de81b624" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-81abded5-2bc0-469a-a1f8-d5a4de81b624" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Deleting offline snapshot 81abded5-2bc0-469a-a1f8-d5a4de81b624 of volume 5517e3de-0195-408d-a17b-5a9fecd7005a {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] snapshot_file for this snap is: volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[739095a2-4032-49c1-8359-d3be1c4fa138]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:40 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 Aug 28 20:18:40 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:41 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 1G" returned: 0 in 0.934s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce921e1-b719-4960-b518-3d0d3359433e -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:41 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce921e1-b719-4960-b518-3d0d3359433e -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 Aug 28 20:18:41 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:41 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624" returned: 0 in 0.751s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5517e3de-0195-408d-a17b-5a9fecd7005a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ee475a-e90e-447c-87e6-8a5c32abcc17]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:41 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a Aug 28 20:18:41 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:41 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce921e1-b719-4960-b518-3d0d3359433e -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5" returned: 0 in 0.563s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:41 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 is being set with open permissions: ugo+rw Aug 28 20:18:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:41 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 Aug 28 20:18:41 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:42 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a" returned: 0 in 0.767s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:42 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 Aug 28 20:18:42 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:42 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5" returned: 0 in 0.479s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:42 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.info Aug 28 20:18:42 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:42 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624" returned: 0 in 0.597s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:42 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624 Aug 28 20:18:42 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:42 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.info" returned: 0 in 0.467s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:42 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.info is being set with open permissions: ugo+rw Aug 28 20:18:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:42 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.info Aug 28 20:18:43 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:43 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a.81abded5-2bc0-469a-a1f8-d5a4de81b624" returned: 0 in 0.257s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-81abded5-2bc0-469a-a1f8-d5a4de81b624" released by "_delete_snapshot" :: held 2.527s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-5517e3de-0195-408d-a17b-5a9fecd7005a" released by "delete_snapshot" :: held 2.558s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-5fffb3b0-af86-4580-9453-796e27d01f69" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-5fffb3b0-af86-4580-9453-796e27d01f69" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-c4bb6d2b-accc-424e-8d94-7cd3c1afa11c" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-c4bb6d2b-accc-424e-8d94-7cd3c1afa11c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Deleting offline snapshot c4bb6d2b-accc-424e-8d94-7cd3c1afa11c of volume 5fffb3b0-af86-4580-9453-796e27d01f69 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] snapshot_file for this snap is: volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:18:43 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.info" returned: 0 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.935s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aa106d-967d-487f-a56e-b4a01a399837]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:43 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-19921d12-c493-4e37-bf98-1ae1e7c7599f tempest-VolumesSnapshotListTestJSON-1413039484 None] Create snapshot completed successfully Aug 28 20:18:43 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c Aug 28 20:18:43 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:43 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c" returned: 0 in 0.382s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fffb3b0-af86-4580-9453-796e27d01f69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef500832-c6fa-44ec-b183-24022e4a484c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:43 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 Aug 28 20:18:43 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] Creating offline snapshot 5419f28e-351e-4fc7-9352-9084330c53a0 of volume 0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:18:44 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69" returned: 0 in 0.456s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[698aa95d-f7f8-4d28-9f5b-e7c806a91535]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:44 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c Aug 28 20:18:44 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:44 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 Aug 28 20:18:44 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:44 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5" returned: 0 in 0.437s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ce921e1-b719-4960-b518-3d0d3359433e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:44 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 1G Aug 28 20:18:44 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:44 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c" returned: 0 in 0.519s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:44 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c Aug 28 20:18:44 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:45 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:45 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 1G" returned: 0 in 0.410s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69.c4bb6d2b-accc-424e-8d94-7cd3c1afa11c" returned: 0 in 0.358s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:45 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 Aug 28 20:18:45 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-c4bb6d2b-accc-424e-8d94-7cd3c1afa11c" released by "_delete_snapshot" :: held 1.869s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-5fffb3b0-af86-4580-9453-796e27d01f69" released by "delete_snapshot" :: held 1.909s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:45 devstack cinder-volume[86028]: WARNING cinder.quota [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1506513712 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1506513712, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:18:45 devstack cinder-volume[86028]: WARNING cinder.quota [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1506513712 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1506513712, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['78defa67-e9f5-41f5-ab45-086b09676015', '31141665-de80-45f5-9bf6-18a6f5f66876', '7bcdf536-347e-4793-9f68-65f44bf0d4fb', 'a0289f4b-7f66-4425-bcd8-d8d52f94943f'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['10fa3eb4-f238-4af6-9625-5942ef3f4090', '006c9f3a-a534-4266-b0e8-1a3a79b469f6', 'a599261b-caff-4d5a-a8c3-faf4de5dd991', 'c8c288b7-132e-415f-871e-cbd5fca703c4'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-24f92b14-9f40-42f8-aecb-ca47eef07223 tempest-GroupSnapshotsTest-399105792 None] group_snapshot bf10c3c3-7c6d-450f-8c97-ddae1595cd72: deleted successfully Aug 28 20:18:45 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0" returned: 0 in 0.448s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:45 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 is being set with open permissions: ugo+rw Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:45 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 Aug 28 20:18:45 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:45 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0" returned: 0 in 0.257s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.667s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4270af02-d03e-4ca6-b7e1-bda61f8739df tempest-VolumesSnapshotListTestJSON-1413039484 None] Create snapshot completed successfully Aug 28 20:18:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] Creating offline snapshot 807de1d1-96f7-4945-a140-8d8ccf03c6f6 of volume 0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:18:46 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c170ba3f-2add-4607-82ab-d8db74e31b5f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:46 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 Aug 28 20:18:46 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:46 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0" returned: 0 in 0.430s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ce921e1-b719-4960-b518-3d0d3359433e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:46 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 1G Aug 28 20:18:46 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-5517e3de-0195-408d-a17b-5a9fecd7005a" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-5517e3de-0195-408d-a17b-5a9fecd7005a" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2e8104-262f-4748-aa42-64e513a4ccd8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:47 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a Aug 28 20:18:47 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:47 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 1G" returned: 0 in 0.456s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:47 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 Aug 28 20:18:47 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:47 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a" returned: 0 in 0.436s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:47 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a Aug 28 20:18:47 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:47 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6" returned: 0 in 0.314s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:47 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 is being set with open permissions: ugo+rw Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:47 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 Aug 28 20:18:47 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:47 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5517e3de-0195-408d-a17b-5a9fecd7005a" returned: 0 in 0.246s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-5517e3de-0195-408d-a17b-5a9fecd7005a" released by "delete_volume" :: held 0.751s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-5fffb3b0-af86-4580-9453-796e27d01f69" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-5fffb3b0-af86-4580-9453-796e27d01f69" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfebdec-b8ed-483d-a3ed-21760c57ad2b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:47 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 Aug 28 20:18:47 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:47 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6" returned: 0 in 0.271s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.594s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f35123c1-97c8-4560-93de-cabb9e2ef3c4 tempest-VolumesSnapshotListTestJSON-1413039484 None] Create snapshot completed successfully Aug 28 20:18:48 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69" returned: 0 in 0.389s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:48 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69 Aug 28 20:18:48 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:48 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5fffb3b0-af86-4580-9453-796e27d01f69" returned: 0 in 0.275s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-5fffb3b0-af86-4580-9453-796e27d01f69" released by "delete_volume" :: held 0.723s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['f3ba4866-72c6-4381-b4be-048c4b0056b3'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:48 devstack cinder-volume[86028]: WARNING cinder.quota [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1506513712 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1506513712, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['214351b7-217c-4300-8c21-db042a6b9525', 'a71b66b1-6318-4f02-9ca0-dd44fa8adcbf', '948c4e44-e64c-4e88-8941-e02d424d7b8c', '47701156-1cf7-4138-b3ff-7399a64df7be'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['a1d4ba3a-7308-4969-9eb1-14d2f686d7c7', 'c74976b6-5372-4424-b518-72b3a67a1f04', '09f54666-caf7-4b55-82f2-f86af3e966ba', '4625a1b0-ba0c-48f1-82d3-20d1b8eae905'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:48 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:18:48 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:49 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:18:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-80d4f282-fc2d-4200-9254-3df55f4c0eb4 tempest-GroupSnapshotsTest-399105792 None] Delete group completed successfully. Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-807de1d1-96f7-4945-a140-8d8ccf03c6f6-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-807de1d1-96f7-4945-a140-8d8ccf03c6f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-quobyte-807de1d1-96f7-4945-a140-8d8ccf03c6f6" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-807de1d1-96f7-4945-a140-8d8ccf03c6f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Deleting offline snapshot 807de1d1-96f7-4945-a140-8d8ccf03c6f6 of volume 0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] snapshot_file for this snap is: volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c9f99b-b858-4908-b088-f7061ca07ab5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:49 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 Aug 28 20:18:49 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a3c44f6f-0acb-4bfa-8436-a24d0ae353c7 tempest-GroupSnapshotsTest-399105792 None] Group tempest-GroupSnapshotsTest-Group-1469730972: creating Aug 28 20:18:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a3c44f6f-0acb-4bfa-8436-a24d0ae353c7 tempest-GroupSnapshotsTest-399105792 None] Group tempest-GroupSnapshotsTest-Group-1469730972: created successfully Aug 28 20:18:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a3c44f6f-0acb-4bfa-8436-a24d0ae353c7 tempest-GroupSnapshotsTest-399105792 None] Create group completed successfully. Aug 28 20:18:49 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6" returned: 0 in 0.395s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ce921e1-b719-4960-b518-3d0d3359433e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b388914-eb20-4a6b-96ef-5f5616e4f1f0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:50 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 Aug 28 20:18:50 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:50 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0" returned: 0 in 0.336s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ce921e1-b719-4960-b518-3d0d3359433e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:50 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 Aug 28 20:18:50 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:50 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6" returned: 0 in 0.388s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:50 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6 Aug 28 20:18:50 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:50 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.807de1d1-96f7-4945-a140-8d8ccf03c6f6" returned: 0 in 0.270s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-807de1d1-96f7-4945-a140-8d8ccf03c6f6" released by "_delete_snapshot" :: held 1.501s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" released by "delete_snapshot" :: held 1.528s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Created reservations ['61dc2d3a-1aec-437c-87c1-64f3d1c5f191', '9dc0781c-2741-4e76-a4a5-4d148b7151a0', '666c8320-28d4-48e0-aeec-e2efe47ef618', 'da41e736-2b4f-4af7-919a-9951bbdfcd2c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:51 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Delete snapshot completed successfully. Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a62efe8d-a2e2-4b28-8540-280490ea5d98 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-807de1d1-96f7-4945-a140-8d8ccf03c6f6-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-5419f28e-351e-4fc7-9352-9084330c53a0-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Flow 'volume_create_manager' (3a5275cf-82e7-49d1-afbc-15efb21bf5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80b05c0-b792-4c5b-a14d-47b4e3252b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-5419f28e-351e-4fc7-9352-9084330c53a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80b05c0-b792-4c5b-a14d-47b4e3252b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1923045761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7a87aeb-f2dc-4360-9eb7-c137af8a7361,host='devstack@QuobyteHD#QuobyteHD',id=29f8b595-3b67-4035-b338-367b648ee97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7146a4dfd44723bfd88ceca25fb7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:52Z,use_quota=True,user_id='43eeeb0889fb4f94acb5fd086814a35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f669cb3f-c0f6-4100-9126-f84cd902cf73),volume_type_id=f669cb3f-c0f6-4100-9126-f84cd902cf73)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c736753-95b8-48f2-8374-3240078c728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c736753-95b8-48f2-8374-3240078c728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122b536c-c496-48fa-85f6-89bf02b943cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122b536c-c496-48fa-85f6-89bf02b943cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f8b595-3b67-4035-b338-367b648ee97d', 'volume_name': 'volume-29f8b595-3b67-4035-b338-367b648ee97d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cbdced-7b5a-493a-be8b-a94c3dbffd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cbdced-7b5a-493a-be8b-a94c3dbffd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d17593-30f9-4729-8b30-08dc97b5a71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:51 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Volume 29f8b595-3b67-4035-b338-367b648ee97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f8b595-3b67-4035-b338-367b648ee97d', 'volume_size': 1} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e7a87aeb-f2dc-4360-9eb7-c137af8a7361,created_at=2026-08-28T18:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1923045761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7a87aeb-f2dc-4360-9eb7-c137af8a7361,host='devstack@QuobyteHD#QuobyteHD',id=29f8b595-3b67-4035-b338-367b648ee97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7146a4dfd44723bfd88ceca25fb7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:52Z,use_quota=True,user_id='43eeeb0889fb4f94acb5fd086814a35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f669cb3f-c0f6-4100-9126-f84cd902cf73),volume_type_id=f669cb3f-c0f6-4100-9126-f84cd902cf73)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Creating volume 29f8b595-3b67-4035-b338-367b648ee97d {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:18:51 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" acquired by "delete_snapshot" :: waited 0.087s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-quobyte-5419f28e-351e-4fc7-9352-9084330c53a0" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:51 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d 1073741824 Aug 28 20:18:51 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-5419f28e-351e-4fc7-9352-9084330c53a0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Deleting offline snapshot 5419f28e-351e-4fc7-9352-9084330c53a0 of volume 0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] snapshot_file for this snap is: volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[885657f2-5114-4ffe-b4fa-bbebab60760c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:52 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 Aug 28 20:18:52 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:52 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d 1073741824" returned: 0 in 0.467s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:52 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d Aug 28 20:18:52 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:52 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0" returned: 0 in 0.457s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ce921e1-b719-4960-b518-3d0d3359433e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc167d8-032e-40e0-bc0d-3c4a6fb02dc9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:52 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 Aug 28 20:18:52 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:52 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d" returned: 0 in 0.270s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d17593-30f9-4729-8b30-08dc97b5a71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f8b595-3b67-4035-b338-367b648ee97d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e7c18a-cd70-4101-b461-b765bb208805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Volume volume-29f8b595-3b67-4035-b338-367b648ee97d (29f8b595-3b67-4035-b338-367b648ee97d): created successfully Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e7c18a-cd70-4101-b461-b765bb208805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Flow 'volume_create_manager' (3a5275cf-82e7-49d1-afbc-15efb21bf5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9f6dbb8f-f010-4c9a-90ff-e999ac3316d0 tempest-GroupSnapshotsTest-399105792 None] Created volume successfully. Aug 28 20:18:52 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5" returned: 0 in 0.405s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ce921e1-b719-4960-b518-3d0d3359433e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:52 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 Aug 28 20:18:52 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] GroupSnapshot 222afe99-f74c-49f8-80f2-cabf5143a0fd: creating. Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Group snapshot 222afe99-f74c-49f8-80f2-cabf5143a0fd: creating. {{(pid=86028) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Creating offline snapshot 4deb9f21-3777-4430-bf5f-3ef4d980dcc3 of volume 29f8b595-3b67-4035-b338-367b648ee97d {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5c924d-0b63-4e80-b0c1-7c5ea8a0fc3e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:53 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0" returned: 0 in 0.437s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:53 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0 Aug 28 20:18:53 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:53 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d Aug 28 20:18:53 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:53 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.5419f28e-351e-4fc7-9352-9084330c53a0" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-5419f28e-351e-4fc7-9352-9084330c53a0" released by "_delete_snapshot" :: held 1.659s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" released by "delete_snapshot" :: held 1.687s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:53 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d" returned: 0 in 0.362s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Created reservations ['1e23a442-3865-4ff7-8a98-cd24428c65b4', '3e7c8af1-406c-4aa7-ba55-e5f7a6eeefc7', '64f937ae-1825-4c34-84e2-65314c8c654d', '843bfb1b-3737-48a8-9eca-c88f265dff6a'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:53 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 1G Aug 28 20:18:53 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Delete snapshot completed successfully. Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ee0bb00a-aada-46ed-a6ae-b8b8b4759367 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-5419f28e-351e-4fc7-9352-9084330c53a0-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-9591e62e-7480-4fb2-9560-5b31903d11f5-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-9591e62e-7480-4fb2-9560-5b31903d11f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-quobyte-9591e62e-7480-4fb2-9560-5b31903d11f5" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-9591e62e-7480-4fb2-9560-5b31903d11f5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Deleting offline snapshot 9591e62e-7480-4fb2-9560-5b31903d11f5 of volume 0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] snapshot_file for this snap is: volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef35cdd-eeda-49ce-b7ef-b78591ea4a2a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:53 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 1G" returned: 0 in 0.428s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f8b595-3b67-4035-b338-367b648ee97d -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:54 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 Aug 28 20:18:54 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:54 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f8b595-3b67-4035-b338-367b648ee97d -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 Aug 28 20:18:54 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:54 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5" returned: 0 in 0.378s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ce921e1-b719-4960-b518-3d0d3359433e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:54 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f8b595-3b67-4035-b338-367b648ee97d -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:54 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[2749139e-8d0b-46b2-a918-00ce615bdbe9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:54 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 Aug 28 20:18:54 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:54 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e Aug 28 20:18:54 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:54 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3" returned: 0 in 0.249s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:54 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.info Aug 28 20:18:54 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:54 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e" returned: 0 in 0.362s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:54 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 Aug 28 20:18:54 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:54 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.info" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:54 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.info is being set with open permissions: ugo+rw: NotImplementedError Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:54 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.info Aug 28 20:18:54 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:54 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5" returned: 0 in 0.322s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:55 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5 Aug 28 20:18:55 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:55 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.info" returned: 0 in 0.253s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d51d3b08-8074-4e7d-95c1-dbd6a12989ac tempest-GroupSnapshotsTest-399105792 None] group_snapshot 222afe99-f74c-49f8-80f2-cabf5143a0fd: created successfully Aug 28 20:18:55 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e.9591e62e-7480-4fb2-9560-5b31903d11f5" returned: 0 in 0.262s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-9591e62e-7480-4fb2-9560-5b31903d11f5" released by "_delete_snapshot" :: held 1.425s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" released by "delete_snapshot" :: held 1.446s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Created reservations ['1d004259-0824-4ec3-b4a7-2c57189a825d', '610057c3-d435-42d4-9ab1-2ff51d39a5bd', '7409259c-8511-41a4-9c89-b3eafd5a58d2', 'b14aa75f-8827-478c-85ed-4bbe5143db1e'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Delete snapshot completed successfully. Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-65c7a8ff-cf26-4b51-9bee-05976b2dd6f1 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-9591e62e-7480-4fb2-9560-5b31903d11f5-delete_snapshot" released by "delete_snapshot" :: held 1.573s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] group_snapshot 222afe99-f74c-49f8-80f2-cabf5143a0fd: deleting Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] group_snapshot 222afe99-f74c-49f8-80f2-cabf5143a0fd: deleting {{(pid=86028) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-29f8b595-3b67-4035-b338-367b648ee97d" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-29f8b595-3b67-4035-b338-367b648ee97d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-4deb9f21-3777-4430-bf5f-3ef4d980dcc3" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-4deb9f21-3777-4430-bf5f-3ef4d980dcc3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Deleting offline snapshot 4deb9f21-3777-4430-bf5f-3ef4d980dcc3 of volume 29f8b595-3b67-4035-b338-367b648ee97d {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] snapshot_file for this snap is: volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4add26-993a-4e71-850f-311f25ed6e11]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:55 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 Aug 28 20:18:55 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:55 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3" returned: 0 in 0.350s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f8b595-3b67-4035-b338-367b648ee97d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa422213-ebbc-40da-8aca-c3a2558a8a4d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-0ce921e1-b719-4960-b518-3d0d3359433e-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:56 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d Aug 28 20:18:56 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-0ce921e1-b719-4960-b518-3d0d3359433e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[82392736-9563-4cb3-b164-ebf1fcd06094]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:56 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e Aug 28 20:18:56 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:56 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d" returned: 0 in 0.400s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:56 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 Aug 28 20:18:56 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:56 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e" returned: 0 in 0.396s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:56 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e Aug 28 20:18:56 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:56 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3" returned: 0 in 0.414s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:56 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3 Aug 28 20:18:56 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:56 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0ce921e1-b719-4960-b518-3d0d3359433e" returned: 0 in 0.290s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-quobyte-0ce921e1-b719-4960-b518-3d0d3359433e" released by "delete_volume" :: held 0.749s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:56 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Created reservations ['5ea1e911-4f64-4496-8d64-a0ae35969a5a', 'c12581e5-1115-4cde-bf46-a6f08b963338', 'b5948cad-5013-45df-a2d5-720cd906df2e', 'd472acfc-3322-423e-ac60-597f5a46ae70'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:57 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d.4deb9f21-3777-4430-bf5f-3ef4d980dcc3" returned: 0 in 0.291s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-4deb9f21-3777-4430-bf5f-3ef4d980dcc3" released by "_delete_snapshot" :: held 1.559s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-29f8b595-3b67-4035-b338-367b648ee97d" released by "delete_snapshot" :: held 1.588s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:57 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:18:57 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:57 devstack cinder-volume[86028]: WARNING cinder.quota [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1244462513 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1244462513, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:18:57 devstack cinder-volume[86028]: WARNING cinder.quota [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1244462513 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1244462513, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] Created reservations ['3cd460d1-81d3-45a6-b32d-0cc1b1c1d454', '3ee1336b-99c0-4cc5-91a2-8c342a06af74', 'fa4a6baa-3e9d-4803-86f7-f658d92c01fa', '03e91af7-1138-4179-8483-245319d7f4a6'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b93acb68-c113-441b-8db7-89efab0930f8 tempest-GroupSnapshotsTest-399105792 None] group_snapshot 222afe99-f74c-49f8-80f2-cabf5143a0fd: deleted successfully Aug 28 20:18:57 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.383s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:18:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Deleted volume successfully. Aug 28 20:18:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2c41b44c-e72f-4b8c-971b-0b2b630e80a9 tempest-VolumesSnapshotListTestJSON-1413039484 None] Lock "cinder-0ce921e1-b719-4960-b518-3d0d3359433e-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "cinder-quobyte-29f8b595-3b67-4035-b338-367b648ee97d" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Flow 'volume_create_manager' (c1382a7b-454a-478b-9735-3bfc25a28001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c600d26e-74a3-4c7c-a5da-cb13192ab30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-29f8b595-3b67-4035-b338-367b648ee97d" acquired by "delete_volume" :: waited 0.083s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c600d26e-74a3-4c7c-a5da-cb13192ab30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-871540169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61fc862-1337-49ae-81ec-1bfbd6ab14f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992915b3d60f42a9b727149267038745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:58Z,use_quota=True,user_id='a62655026837455e9bb59d205d2153dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77d0317-62cf-42f4-b184-f60bc23b226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77d0317-62cf-42f4-b184-f60bc23b226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f1a428-b2a3-4a8c-a8fe-46c159749bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f1a428-b2a3-4a8c-a8fe-46c159749bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61fc862-1337-49ae-81ec-1bfbd6ab14f6', 'volume_name': 'volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552c087d-a01b-4602-8f9e-1bb9087ce94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552c087d-a01b-4602-8f9e-1bb9087ce94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e65726c-8ae7-4669-b050-d3be7421e3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:58 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Volume f61fc862-1337-49ae-81ec-1bfbd6ab14f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6', 'volume_size': 1} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-871540169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61fc862-1337-49ae-81ec-1bfbd6ab14f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992915b3d60f42a9b727149267038745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:18:58Z,use_quota=True,user_id='a62655026837455e9bb59d205d2153dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Creating volume f61fc862-1337-49ae-81ec-1bfbd6ab14f6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:18:58 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[56005c6c-695a-4010-8416-e0982a730f96]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:58 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6 1073741824 Aug 28 20:18:58 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:58 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d Aug 28 20:18:58 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:58 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d" returned: 0 in 0.450s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:58 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d Aug 28 20:18:58 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:58 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6 1073741824" returned: 0 in 0.546s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:58 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6 Aug 28 20:18:58 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:59 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29f8b595-3b67-4035-b338-367b648ee97d" returned: 0 in 0.377s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:59 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Lock "cinder-quobyte-29f8b595-3b67-4035-b338-367b648ee97d" released by "delete_volume" :: held 0.983s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6" returned: 0 in 0.280s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e65726c-8ae7-4669-b050-d3be7421e3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4db51b8-c56b-4dd4-adcc-85f9e7d16590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:18:59 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Volume volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6 (f61fc862-1337-49ae-81ec-1bfbd6ab14f6): created successfully Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4db51b8-c56b-4dd4-adcc-85f9e7d16590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Flow 'volume_create_manager' (c1382a7b-454a-478b-9735-3bfc25a28001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:18:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-50f59689-6d44-484a-b9b8-a98eaed4c856 tempest-AttachVolumeNegativeTest-868475344 None] Created volume successfully. Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Created reservations ['12a70329-3597-4479-a22f-e15771a126a4'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:59 devstack cinder-volume[86028]: WARNING cinder.quota [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1244462513 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1244462513, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Created reservations ['205e65bb-3c02-4b6f-821e-1821b6d4e42e', 'a997ec75-2b7b-4505-90f1-1326bd25eea5', '281486a6-f19e-4112-827c-7319e641609a', 'd884e01d-df80-4a38-b2d4-4b7542ff0b00'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:18:59 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:18:59 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:18:59 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.272s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:18:59 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:18:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-55fca369-40c9-4752-897a-4b906089cecd tempest-GroupSnapshotsTest-399105792 None] Delete group completed successfully. Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Flow 'volume_create_manager' (7394082e-a59e-4ffc-84ab-d1a5e0ef7085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369e9be4-a7d3-400a-b4ab-30e41d10c066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369e9be4-a7d3-400a-b4ab-30e41d10c066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-50597572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e33be5c-3b58-4fc7-bc0a-924e4452c689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58bf110a165c47009c3b6cdeee8aabe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:19:01Z,use_quota=True,user_id='6dff5a418f104e9e8421c483c10a37e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24325c48-cf32-4af2-bff3-5c2307138acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24325c48-cf32-4af2-bff3-5c2307138acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbe6a47-0f21-4276-94ce-eb42b4350446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbe6a47-0f21-4276-94ce-eb42b4350446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e33be5c-3b58-4fc7-bc0a-924e4452c689', 'volume_name': 'volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f89adb0-0527-40cb-8352-280965379e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f89adb0-0527-40cb-8352-280965379e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f016fd3-ef9c-4ae9-b7b6-60484a37693f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:01 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Volume 2e33be5c-3b58-4fc7-bc0a-924e4452c689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689', 'volume_size': 1} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-50597572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e33be5c-3b58-4fc7-bc0a-924e4452c689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58bf110a165c47009c3b6cdeee8aabe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:19:01Z,use_quota=True,user_id='6dff5a418f104e9e8421c483c10a37e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Creating volume 2e33be5c-3b58-4fc7-bc0a-924e4452c689 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:19:01 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:01 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689 1073741824 Aug 28 20:19:01 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-9d446808-6f83-4dec-8e70-df8e2546ff27 req-4a030a77-97fb-41a9-884c-62b3fe761df9 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:01 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689 1073741824" returned: 0 in 0.607s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:01 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689 Aug 28 20:19:01 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:02 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689" returned: 0 in 0.291s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:19:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-9d446808-6f83-4dec-8e70-df8e2546ff27 req-4a030a77-97fb-41a9-884c-62b3fe761df9 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.902s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f016fd3-ef9c-4ae9-b7b6-60484a37693f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab16a692-d476-4238-ba0a-7811c941d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-9d446808-6f83-4dec-8e70-df8e2546ff27 req-4a030a77-97fb-41a9-884c-62b3fe761df9 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:02 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Volume volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689 (2e33be5c-3b58-4fc7-bc0a-924e4452c689): created successfully Aug 28 20:19:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab16a692-d476-4238-ba0a-7811c941d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Flow 'volume_create_manager' (7394082e-a59e-4ffc-84ab-d1a5e0ef7085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:19:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e0aff568-b5c8-4f6b-8c78-5a00a15aa07f tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Created volume successfully. Aug 28 20:19:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-9d446808-6f83-4dec-8e70-df8e2546ff27 req-4a030a77-97fb-41a9-884c-62b3fe761df9 tempest-AttachVolumeNegativeTest-868475344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e17ce6fc-4ef7-4869-abbd-908a50816c6a', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:19:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-9d446808-6f83-4dec-8e70-df8e2546ff27 req-4a030a77-97fb-41a9-884c-62b3fe761df9 tempest-AttachVolumeNegativeTest-868475344 None] attachment_update completed successfully. Aug 28 20:19:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fa2e8adc-6dba-4659-8087-b343d5048c28 req-67d5c0ed-1342-4fd4-9cfd-316cf7be9407 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fa2e8adc-6dba-4659-8087-b343d5048c28 req-67d5c0ed-1342-4fd4-9cfd-316cf7be9407 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-fa2e8adc-6dba-4659-8087-b343d5048c28 req-67d5c0ed-1342-4fd4-9cfd-316cf7be9407 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fa2e8adc-6dba-4659-8087-b343d5048c28 req-67d5c0ed-1342-4fd4-9cfd-316cf7be9407 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08553eab-968e-4a66-83a9-2abb87cfb466', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:19:04 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-fa2e8adc-6dba-4659-8087-b343d5048c28 req-67d5c0ed-1342-4fd4-9cfd-316cf7be9407 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] attachment_update completed successfully. Aug 28 20:19:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:19:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:19:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:19:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:06 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:19:06 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:07 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.430s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:19:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:19:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:19:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:19:08 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-6755e11f-7c3c-4920-ad4e-b49855ad8e7b req-e98bba08-288d-41f3-92bf-0b492717169d tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Terminate volume connection completed successfully. Aug 28 20:19:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-6755e11f-7c3c-4920-ad4e-b49855ad8e7b req-e98bba08-288d-41f3-92bf-0b492717169d tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Deleting attachment 08553eab-968e-4a66-83a9-2abb87cfb466. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:19:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Acquiring lock "cinder-2e33be5c-3b58-4fc7-bc0a-924e4452c689-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "cinder-2e33be5c-3b58-4fc7-bc0a-924e4452c689-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Acquiring lock "cinder-quobyte-2e33be5c-3b58-4fc7-bc0a-924e4452c689" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "cinder-quobyte-2e33be5c-3b58-4fc7-bc0a-924e4452c689" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:09 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe16011-d286-4fdc-8aba-2c39d336ff10]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:09 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689 Aug 28 20:19:09 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:10 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689" returned: 0 in 0.503s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:10 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689 Aug 28 20:19:10 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:10 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2e33be5c-3b58-4fc7-bc0a-924e4452c689" returned: 0 in 0.390s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "cinder-quobyte-2e33be5c-3b58-4fc7-bc0a-924e4452c689" released by "delete_volume" :: held 0.966s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Created reservations ['cc98ef19-b12c-41a9-b070-d7c6bd8b4078', '89d12d43-3710-418a-ab99-32d9b591e0e8', '06d3aa77-7367-4641-8e84-6319960bd654', '95570d9f-b90f-486d-9c39-b203fe7c3116'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:10 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:19:10 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:11 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.358s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:11 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:19:11 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Deleted volume successfully. Aug 28 20:19:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-eb0bbd60-8969-4ba6-90c0-a3278264e800 tempest-TestServerVolumeAttachScenarioOldVersion-2027044807 None] Lock "cinder-2e33be5c-3b58-4fc7-bc0a-924e4452c689-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:20 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=127,cinder:SELECT=127,cinder:DELETE=8,cinder:INSERT=29 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:19:21 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=125,cinder:SELECT=125,cinder:INSERT=30,cinder:DELETE=4 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Flow 'volume_create_manager' (3bfae533-e561-4c9d-8aaa-c9af358cce8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a0f2b0-ef74-4fd3-a10f-a624f9411d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a0f2b0-ef74-4fd3-a10f-a624f9411d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-626781069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c636b541-810f-40ac-87f8-d8d0849c7dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566f0705e07142fe9b18096853f2ae86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:19:32Z,use_quota=True,user_id='f05d651ecd01403d80bb9e23174d0ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c90ec3-def5-4090-855e-2e23be5fd4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c90ec3-def5-4090-855e-2e23be5fd4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485fdf46-56c0-459b-98b8-23e89be079c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485fdf46-56c0-459b-98b8-23e89be079c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c636b541-810f-40ac-87f8-d8d0849c7dda', 'volume_name': 'volume-c636b541-810f-40ac-87f8-d8d0849c7dda', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ea812d-cdf3-4432-bfad-5bfc375296de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ea812d-cdf3-4432-bfad-5bfc375296de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258a4943-21f1-4b08-a990-051fb194c391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:32 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Volume c636b541-810f-40ac-87f8-d8d0849c7dda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c636b541-810f-40ac-87f8-d8d0849c7dda', 'volume_size': 1} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-626781069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c636b541-810f-40ac-87f8-d8d0849c7dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566f0705e07142fe9b18096853f2ae86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:19:32Z,use_quota=True,user_id='f05d651ecd01403d80bb9e23174d0ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Creating volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:19:32 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:19:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:32 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda 1073741824 Aug 28 20:19:32 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:33 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda 1073741824" returned: 0 in 0.516s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:33 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda Aug 28 20:19:33 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:33 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda" returned: 0 in 0.287s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258a4943-21f1-4b08-a990-051fb194c391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c636b541-810f-40ac-87f8-d8d0849c7dda', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029a74b3-70eb-46d7-9482-4a8e304f92b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:33 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Volume volume-c636b541-810f-40ac-87f8-d8d0849c7dda (c636b541-810f-40ac-87f8-d8d0849c7dda): created successfully Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029a74b3-70eb-46d7-9482-4a8e304f92b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Flow 'volume_create_manager' (3bfae533-e561-4c9d-8aaa-c9af358cce8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Flow 'volume_create_manager' (389350ca-64ed-47aa-982a-e6cfaf9d821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e689d6-a579-414f-a6f8-b6c164d7f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ac6039d3-2ac3-4956-afd2-43eff6f1aa93 tempest-SnapshotsActionsTest-1865766585 None] Created volume successfully. Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e689d6-a579-414f-a6f8-b6c164d7f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-659734029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402866d3-c527-49e7-aa38-392b07a14ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1c00254d10446c9a81568d26ad2ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:19:33Z,use_quota=True,user_id='95185821f21b4bf38ce71e0a32d9dd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3f2f149-db3a-4118-aa45-3b1a16cba21c),volume_type_id=b3f2f149-db3a-4118-aa45-3b1a16cba21c)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd4e506-ade6-4c0c-be4d-0323dea3f67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd4e506-ade6-4c0c-be4d-0323dea3f67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eacb80a-4e82-4923-b2c0-2d62a2f99cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eacb80a-4e82-4923-b2c0-2d62a2f99cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402866d3-c527-49e7-aa38-392b07a14ee6', 'volume_name': 'volume-402866d3-c527-49e7-aa38-392b07a14ee6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f619b0-e1a8-4240-a3ef-8567bd6d1e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0f619b0-e1a8-4240-a3ef-8567bd6d1e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2ccf41-5864-4c5f-afb2-6457aaf71713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:33 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Volume 402866d3-c527-49e7-aa38-392b07a14ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402866d3-c527-49e7-aa38-392b07a14ee6', 'volume_size': 1} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-659734029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402866d3-c527-49e7-aa38-392b07a14ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1c00254d10446c9a81568d26ad2ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:19:33Z,use_quota=True,user_id='95185821f21b4bf38ce71e0a32d9dd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3f2f149-db3a-4118-aa45-3b1a16cba21c),volume_type_id=b3f2f149-db3a-4118-aa45-3b1a16cba21c)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Creating volume 402866d3-c527-49e7-aa38-392b07a14ee6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:19:33 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:33 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6 1073741824 Aug 28 20:19:33 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Flow 'volume_create_manager' (10cdf1e6-0d14-44c5-9134-5c858952e4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516ff408-bc6e-4f9a-ac16-434da2d97ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516ff408-bc6e-4f9a-ac16-434da2d97ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-326923000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5a759a-0eea-4290-ae55-ed885bc86844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1c00254d10446c9a81568d26ad2ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:19:34Z,use_quota=True,user_id='95185821f21b4bf38ce71e0a32d9dd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fc6e018-9a76-4f65-95b5-0310f785453e),volume_type_id=0fc6e018-9a76-4f65-95b5-0310f785453e)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d223612-8ef6-451b-9c72-086643f10745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d223612-8ef6-451b-9c72-086643f10745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe91999-0011-4009-8465-64ed487f721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe91999-0011-4009-8465-64ed487f721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5a759a-0eea-4290-ae55-ed885bc86844', 'volume_name': 'volume-ec5a759a-0eea-4290-ae55-ed885bc86844', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c50e8ce-d152-405f-8c69-51669bac2c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c50e8ce-d152-405f-8c69-51669bac2c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de67b13-555b-4a78-881b-cfc38f4d3827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:34 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Volume ec5a759a-0eea-4290-ae55-ed885bc86844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5a759a-0eea-4290-ae55-ed885bc86844', 'volume_size': 1} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:34 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6 1073741824" returned: 0 in 0.547s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:34 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6 Aug 28 20:19:34 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:34 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6" returned: 0 in 0.270s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.532s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-326923000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5a759a-0eea-4290-ae55-ed885bc86844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1c00254d10446c9a81568d26ad2ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:19:34Z,use_quota=True,user_id='95185821f21b4bf38ce71e0a32d9dd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fc6e018-9a76-4f65-95b5-0310f785453e),volume_type_id=0fc6e018-9a76-4f65-95b5-0310f785453e)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Creating volume ec5a759a-0eea-4290-ae55-ed885bc86844 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:19:34 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:34 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844 1073741824 Aug 28 20:19:34 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2ccf41-5864-4c5f-afb2-6457aaf71713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402866d3-c527-49e7-aa38-392b07a14ee6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59afb6c-fcb8-4bec-8d27-0c47e4f48d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:34 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Volume volume-402866d3-c527-49e7-aa38-392b07a14ee6 (402866d3-c527-49e7-aa38-392b07a14ee6): created successfully Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59afb6c-fcb8-4bec-8d27-0c47e4f48d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Flow 'volume_create_manager' (389350ca-64ed-47aa-982a-e6cfaf9d821f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:19:34 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-43525e49-2a5e-4fb0-802b-69d33ad785d1 tempest-TestInstancesWithCinderVolumes-25371545 None] Created volume successfully. Aug 28 20:19:34 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Flow 'volume_create_manager' (e1f74c4b-9715-4ca8-92a2-ba947be96294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa9bbb5-9a40-4216-8e7d-c2019deb8955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa9bbb5-9a40-4216-8e7d-c2019deb8955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-557650362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63eadac-7447-4a78-8d02-d5c6d58b7a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1c00254d10446c9a81568d26ad2ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:19:35Z,use_quota=True,user_id='95185821f21b4bf38ce71e0a32d9dd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7762d909-548c-47b8-ace4-c7c18429dadb),volume_type_id=7762d909-548c-47b8-ace4-c7c18429dadb)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3d773f-d1e1-4956-b61a-1886b18e7e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3d773f-d1e1-4956-b61a-1886b18e7e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105c535b-8d47-4018-b8a6-f0f6becfc3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.image.glance [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Creating Keystone auth plugin from conf {{(pid=86028) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:35 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844 1073741824" returned: 0 in 0.625s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:35 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844 Aug 28 20:19:35 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105c535b-8d47-4018-b8a6-f0f6becfc3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b63eadac-7447-4a78-8d02-d5c6d58b7a47', 'volume_name': 'volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47', 'volume_size': 1, 'image_id': '364b4397-32eb-43f3-a7bd-7ff63bb01871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/364b4397-32eb-43f3-a7bd-7ff63bb01871', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--732007641', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5e1c00254d10446c9a81568d26ad2ec4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '364b4397-32eb-43f3-a7bd-7ff63bb01871', 'created_at': datetime.datetime(2026, 8, 28, 18, 19, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 19, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/364b4397-32eb-43f3-a7bd-7ff63bb01871/file', 'properties': {}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b74b18-1e04-4e6f-aaef-928d5414f676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:35 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b74b18-1e04-4e6f-aaef-928d5414f676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70793ec9-09a4-4434-b4d6-8cbc986bb61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:35 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Volume b63eadac-7447-4a78-8d02-d5c6d58b7a47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47', 'volume_size': 1, 'image_id': '364b4397-32eb-43f3-a7bd-7ff63bb01871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/364b4397-32eb-43f3-a7bd-7ff63bb01871', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--732007641', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5e1c00254d10446c9a81568d26ad2ec4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '364b4397-32eb-43f3-a7bd-7ff63bb01871', 'created_at': datetime.datetime(2026, 8, 28, 18, 19, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 19, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/364b4397-32eb-43f3-a7bd-7ff63bb01871/file', 'properties': {}}, 'image_service': } Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Trying to clone b63eadac-7447-4a78-8d02-d5c6d58b7a47 from image 364b4397-32eb-43f3-a7bd-7ff63bb01871 at location (None, [{'url': 'file:///opt/stack/data/glance/images/364b4397-32eb-43f3-a7bd-7ff63bb01871', 'metadata': {}}]). {{(pid=86028) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844" returned: 0 in 0.319s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.430s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de67b13-555b-4a78-881b-cfc38f4d3827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5a759a-0eea-4290-ae55-ed885bc86844', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc75cee7-5c5f-4453-8422-7f8930b71436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Creating offline snapshot 299d898c-29b0-4546-82fe-25639b6a6fee of volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:19:35 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Volume volume-ec5a759a-0eea-4290-ae55-ed885bc86844 (ec5a759a-0eea-4290-ae55-ed885bc86844): created successfully Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc75cee7-5c5f-4453-8422-7f8930b71436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Flow 'volume_create_manager' (10cdf1e6-0d14-44c5-9134-5c858952e4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4c6736-6463-4ce2-b3a2-ba42e210d94a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:35 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e69ce67a-8e15-46e1-bc1d-637a532c3a3b tempest-TestInstancesWithCinderVolumes-25371545 None] Created volume successfully. Aug 28 20:19:35 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda Aug 28 20:19:35 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:36 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda" returned: 0 in 0.423s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:36 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee 1G Aug 28 20:19:36 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:36 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee 1G" returned: 0 in 0.477s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:36 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:19:36 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:36 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.330s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:36 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee is being set with open permissions: ugo+rw Aug 28 20:19:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:36 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:19:36 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:37 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.314s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:37 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.info Aug 28 20:19:37 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:37 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.info" returned: 0 in 0.292s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:37 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.info is being set with open permissions: ugo+rw Aug 28 20:19:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:37 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.info Aug 28 20:19:37 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:37 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.info" returned: 0 in 0.267s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:37 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8505d953-5541-4d15-8469-acf8b4ab269b tempest-SnapshotsActionsTest-1865766585 None] Create snapshot completed successfully Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] Creating offline snapshot 7ff54866-35b2-41dd-a052-17d3831bc5b9 of volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[100831d8-c834-4554-ac33-759d215bf611]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:39 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:19:39 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:39 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.418s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:39 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 1G Aug 28 20:19:39 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD, size 20.69 MB, duration 4.17 sec {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 20:19:39 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Image download 20.69 MB at 4.97 MB/s Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e57fdfa-dc5d-4636-8145-6d3f0dc0f23e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:39 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD Aug 28 20:19:39 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:40 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 1G" returned: 0 in 0.611s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:40 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Temporary image 364b4397-32eb-43f3-a7bd-7ff63bb01871 is fetched for user 95185821f21b4bf38ce71e0a32d9dd4b. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 20:19:40 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 Aug 28 20:19:40 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7846a08-805d-4156-89ec-21653fef0b54]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:40 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD Aug 28 20:19:40 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:40 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9" returned: 0 in 0.415s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:40 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 is being set with open permissions: ugo+rw Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:40 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 Aug 28 20:19:40 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:40 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:40 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9" returned: 0 in 0.303s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.189s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-557650362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63eadac-7447-4a78-8d02-d5c6d58b7a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1c00254d10446c9a81568d26ad2ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:19:35Z,use_quota=True,user_id='95185821f21b4bf38ce71e0a32d9dd4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7762d909-548c-47b8-ace4-c7c18429dadb),volume_type_id=7762d909-548c-47b8-ace4-c7c18429dadb)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Creating volume b63eadac-7447-4a78-8d02-d5c6d58b7a47 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:19:40 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:19:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:40 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 1073741824 Aug 28 20:19:41 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fa94ef8a-dc88-40fe-9ad4-141090492c3f tempest-SnapshotsActionsTest-1865766585 None] Create snapshot completed successfully Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-7ff54866-35b2-41dd-a052-17d3831bc5b9-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-7ff54866-35b2-41dd-a052-17d3831bc5b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-quobyte-7ff54866-35b2-41dd-a052-17d3831bc5b9" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-7ff54866-35b2-41dd-a052-17d3831bc5b9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Deleting offline snapshot 7ff54866-35b2-41dd-a052-17d3831bc5b9 of volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] snapshot_file for this snap is: volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41eb115-4cd5-4a1a-a05b-c4543ea0588f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:41 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 1073741824" returned: 0 in 0.499s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:41 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 Aug 28 20:19:41 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:41 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 Aug 28 20:19:41 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:41 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9" returned: 0 in 0.412s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:19:41 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47" returned: 0 in 0.317s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5129b29e-d6a5-41cd-9013-bded60659cbc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Attempting download of 364b4397-32eb-43f3-a7bd-7ff63bb01871 ((None, [{'url': 'file:///opt/stack/data/glance/images/364b4397-32eb-43f3-a7bd-7ff63bb01871', 'metadata': {}}])) to volume b63eadac-7447-4a78-8d02-d5c6d58b7a47. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d3705c-2a25-44c1-8da2-5f4e6c7321df]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_364b4397-32eb-43f3-a7bd-7ff63bb01871_avsy08yv {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:41 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:19:41 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:42 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_364b4397-32eb-43f3-a7bd-7ff63bb01871_avsy08yv Aug 28 20:19:42 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:42 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_364b4397-32eb-43f3-a7bd-7ff63bb01871_avsy08yv" returned: 0 in 0.434s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_364b4397-32eb-43f3-a7bd-7ff63bb01871_avsy08yv {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:42 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.582s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:42 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 Aug 28 20:19:42 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:42 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_364b4397-32eb-43f3-a7bd-7ff63bb01871_avsy08yv Aug 28 20:19:42 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:42 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_364b4397-32eb-43f3-a7bd-7ff63bb01871_avsy08yv" returned: 1 in 0.554s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_364b4397-32eb-43f3-a7bd-7ff63bb01871_avsy08yv' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d720a54b-0595-4c9e-8d7d-8b5766e0e67a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:42 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9" returned: 0 in 0.553s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:43 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9 Aug 28 20:19:43 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:43 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD Aug 28 20:19:43 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:43 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.7ff54866-35b2-41dd-a052-17d3831bc5b9" returned: 0 in 0.548s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-7ff54866-35b2-41dd-a052-17d3831bc5b9" released by "_delete_snapshot" :: held 2.229s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" released by "delete_snapshot" :: held 2.261s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:43 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:43 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] 364b4397-32eb-43f3-a7bd-7ff63bb01871 was qcow2, converting to qcow2 {{(pid=86028) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 20:19:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:43 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 Aug 28 20:19:43 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:43 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Created reservations ['95412c7f-3450-452b-870d-c3bd6694a2bf', '81e5775e-6033-4513-97ae-9389c2462a02', '4c54395d-64ef-4de7-bce9-eb3d7d582d98', '74cdabee-560c-4b4a-a377-de93f96c6980'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:19:43 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Delete snapshot completed successfully. Aug 28 20:19:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-30923264-393b-4e48-82d8-8cc02ae88a26 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-7ff54866-35b2-41dd-a052-17d3831bc5b9-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] Creating offline snapshot 66b17321-a6d1-479d-b203-301e0f9ca089 of volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:19:45 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a2e81-c60a-4b83-be05-02c7099ee99f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:45 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:19:45 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:45 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.610s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:19:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:45 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 1G Aug 28 20:19:45 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:46 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47" returned: 0 in 2.476s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_364b4397-32eb-43f3-a7bd-7ff63bb01871__huwzfwedevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:19:46 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Converted 112.00 MB image at 45.20 MB/s Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:46 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 1G Aug 28 20:19:46 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:46 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 1G" returned: 0 in 0.621s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:46 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 Aug 28 20:19:46 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:46 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 1G" returned: 0 in 0.506s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Downloaded image 364b4397-32eb-43f3-a7bd-7ff63bb01871 ((None, [{'url': 'file:///opt/stack/data/glance/images/364b4397-32eb-43f3-a7bd-7ff63bb01871', 'metadata': {}}])) to volume b63eadac-7447-4a78-8d02-d5c6d58b7a47 successfully. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Temporary image 364b4397-32eb-43f3-a7bd-7ff63bb01871 for user 95185821f21b4bf38ce71e0a32d9dd4b is deleted. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Marking volume b63eadac-7447-4a78-8d02-d5c6d58b7a47 as bootable. {{(pid=86028) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Copying metadata from image 364b4397-32eb-43f3-a7bd-7ff63bb01871 to b63eadac-7447-4a78-8d02-d5c6d58b7a47. {{(pid=86028) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Creating volume glance metadata for volume b63eadac-7447-4a78-8d02-d5c6d58b7a47 backed by image 364b4397-32eb-43f3-a7bd-7ff63bb01871 with: {'image_id': '364b4397-32eb-43f3-a7bd-7ff63bb01871', 'image_name': 'tempest-scenario-img--732007641', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86028) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70793ec9-09a4-4434-b4d6-8cbc986bb61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47', 'volume_size': 1, 'image_id': '364b4397-32eb-43f3-a7bd-7ff63bb01871', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/364b4397-32eb-43f3-a7bd-7ff63bb01871', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--732007641', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5e1c00254d10446c9a81568d26ad2ec4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '364b4397-32eb-43f3-a7bd-7ff63bb01871', 'created_at': datetime.datetime(2026, 8, 28, 18, 19, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 19, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/364b4397-32eb-43f3-a7bd-7ff63bb01871/file', 'properties': {}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872b9136-adc0-4bc2-adb2-c07995ccbb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:19:46 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Volume volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 (b63eadac-7447-4a78-8d02-d5c6d58b7a47): created successfully Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872b9136-adc0-4bc2-adb2-c07995ccbb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Flow 'volume_create_manager' (e1f74c4b-9715-4ca8-92a2-ba947be96294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:19:46 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:46 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d711964f-c8e2-4b5c-8451-2119d03874dd tempest-TestInstancesWithCinderVolumes-25371545 None] Created volume successfully. Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089" returned: 0 in 0.450s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:46 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 is being set with open permissions: ugo+rw Aug 28 20:19:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:46 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 Aug 28 20:19:46 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:47 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089" returned: 0 in 0.317s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:47 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9b1d4b1f-cb93-4e59-8400-f970324f7e19 tempest-SnapshotsActionsTest-1865766585 None] Create snapshot completed successfully Aug 28 20:19:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-66b17321-a6d1-479d-b203-301e0f9ca089-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-66b17321-a6d1-479d-b203-301e0f9ca089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-quobyte-66b17321-a6d1-479d-b203-301e0f9ca089" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-66b17321-a6d1-479d-b203-301e0f9ca089" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Deleting offline snapshot 66b17321-a6d1-479d-b203-301e0f9ca089 of volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:19:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] snapshot_file for this snap is: volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:19:48 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7669e5-299c-4cb2-8fcf-2347b949db0b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:48 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 Aug 28 20:19:48 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:48 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089" returned: 0 in 0.446s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:19:49 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dd9c04-1ce2-4629-83cd-0b80f50363f0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:49 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:19:49 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:49 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.472s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:19:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:49 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 Aug 28 20:19:49 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:50 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089" returned: 0 in 0.573s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:50 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089 Aug 28 20:19:50 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:50 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.66b17321-a6d1-479d-b203-301e0f9ca089" returned: 0 in 0.436s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-66b17321-a6d1-479d-b203-301e0f9ca089" released by "_delete_snapshot" :: held 2.085s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" released by "delete_snapshot" :: held 2.130s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:50 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Created reservations ['233f0039-d156-49ab-ab30-ec02e17bf8b4', '4f7508e1-b35a-4593-b4f9-a817c6c19401', '6d56adf9-457f-46e5-9901-9b24e610ab01', '58a53f5f-07ce-4807-8d6d-75144828ff5b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:19:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Delete snapshot completed successfully. Aug 28 20:19:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c66883f9-0f4e-464b-9ecd-256f6e2ebacb tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-66b17321-a6d1-479d-b203-301e0f9ca089-delete_snapshot" released by "delete_snapshot" :: held 2.427s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:51 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-1c6df004-2031-45bf-94b8-bfde17dea1f9 req-363f3080-e549-47e3-a2df-726c1a2b2698 tempest-AttachVolumeNegativeTest-868475344 None] Terminate volume connection completed successfully. Aug 28 20:19:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-1c6df004-2031-45bf-94b8-bfde17dea1f9 req-363f3080-e549-47e3-a2df-726c1a2b2698 tempest-AttachVolumeNegativeTest-868475344 None] Deleting attachment e17ce6fc-4ef7-4869-abbd-908a50816c6a. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:19:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] Creating offline snapshot 2a0ded18-ad81-4bfa-9076-2dfc20335c50 of volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:19:52 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8df03a1-6d7d-48e1-9dea-1b85615edab5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:52 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:19:52 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:53 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-6d6ea276-b3b6-4472-bdde-a5569eba77bc req-f30d3c04-9112-4172-832d-e9ff207bbdf7 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.797s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:19:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:53 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 1G Aug 28 20:19:53 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:53 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 1G" returned: 0 in 0.564s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:53 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 Aug 28 20:19:53 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:53 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50" returned: 0 in 0.363s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:53 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 is being set with open permissions: ugo+rw Aug 28 20:19:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:53 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 Aug 28 20:19:53 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:54 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50" returned: 0 in 0.354s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-6d6ea276-b3b6-4472-bdde-a5569eba77bc req-f30d3c04-9112-4172-832d-e9ff207bbdf7 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.334s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-6d6ea276-b3b6-4472-bdde-a5569eba77bc req-f30d3c04-9112-4172-832d-e9ff207bbdf7 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:19:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e0aedf3c-c494-4b5e-8766-2960ec41aa8e tempest-SnapshotsActionsTest-1865766585 None] Create snapshot completed successfully Aug 28 20:19:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-6d6ea276-b3b6-4472-bdde-a5569eba77bc req-f30d3c04-9112-4172-832d-e9ff207bbdf7 tempest-TestInstancesWithCinderVolumes-25371545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4e5a527-9b53-4b5d-b510-1c6ba5bd3761', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:19:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-6d6ea276-b3b6-4472-bdde-a5569eba77bc req-f30d3c04-9112-4172-832d-e9ff207bbdf7 tempest-TestInstancesWithCinderVolumes-25371545 None] attachment_update completed successfully. Aug 28 20:19:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-2a0ded18-ad81-4bfa-9076-2dfc20335c50-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-2a0ded18-ad81-4bfa-9076-2dfc20335c50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-quobyte-2a0ded18-ad81-4bfa-9076-2dfc20335c50" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:19:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-2a0ded18-ad81-4bfa-9076-2dfc20335c50" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:19:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Deleting offline snapshot 2a0ded18-ad81-4bfa-9076-2dfc20335c50 of volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:19:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] snapshot_file for this snap is: volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:19:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b053ac34-e0cd-48b9-a3fa-3992d86088f6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:55 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 Aug 28 20:19:55 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:56 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50" returned: 0 in 0.466s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:19:56 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[16600721-37ca-47e1-8d6e-046225e38a46]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:56 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:19:56 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:56 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.515s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:19:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:56 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 Aug 28 20:19:56 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:57 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50" returned: 0 in 0.444s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:57 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50 Aug 28 20:19:57 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:57 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Aug 28 20:19:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.2a0ded18-ad81-4bfa-9076-2dfc20335c50" returned: 0 in 0.565s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:19:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-2a0ded18-ad81-4bfa-9076-2dfc20335c50" released by "_delete_snapshot" :: held 2.123s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" released by "delete_snapshot" :: held 2.175s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:57 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Created reservations ['64080e9b-3458-4b44-a5a2-0f694e3d0616', '57812659-b05a-474c-8050-e60e9a7782f9', '9ad3219d-116e-4017-89a3-dc701abc5b36', '506d03aa-563e-48e5-bc2a-a89b4000b4a8'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:19:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Delete snapshot completed successfully. Aug 28 20:19:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d0b94b66-a81e-4ad3-a0e8-84d71c73c65d tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-2a0ded18-ad81-4bfa-9076-2dfc20335c50-delete_snapshot" released by "delete_snapshot" :: held 2.406s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:19:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:19:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:19:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] Creating offline snapshot 38db94ed-1561-4511-bbdf-2ed7367cb920 of volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:19:59 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5687395-4d62-431e-bbe9-61169f19991f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:19:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:19:59 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:19:59 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:19:59 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.770s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:20:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:00 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 1G Aug 28 20:20:00 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:00 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 1G" returned: 0 in 0.670s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:00 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 Aug 28 20:20:00 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:01 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920" returned: 0 in 0.398s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:01 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 is being set with open permissions: ugo+rw Aug 28 20:20:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:01 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 Aug 28 20:20:01 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:01 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:01 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-74636f91-dd7d-481a-bcab-20608f3c1cea tempest-SnapshotsActionsTest-1865766585 None] Create snapshot completed successfully Aug 28 20:20:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-38db94ed-1561-4511-bbdf-2ed7367cb920-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-38db94ed-1561-4511-bbdf-2ed7367cb920-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Acquiring lock "cinder-quobyte-38db94ed-1561-4511-bbdf-2ed7367cb920" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-38db94ed-1561-4511-bbdf-2ed7367cb920" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Deleting offline snapshot 38db94ed-1561-4511-bbdf-2ed7367cb920 of volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:20:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] snapshot_file for this snap is: volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:20:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f4a93f-cfec-41d3-9171-71e4a8a19e54]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:02 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 Aug 28 20:20:02 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:03 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920" returned: 0 in 0.713s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:20:03 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[de99b439-5610-4944-bbd8-b95b033188db]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:03 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:20:03 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:03 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.572s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:20:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:04 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 Aug 28 20:20:04 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:04 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920" returned: 0 in 0.657s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:04 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920 Aug 28 20:20:04 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:05 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.38db94ed-1561-4511-bbdf-2ed7367cb920" returned: 0 in 0.413s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-38db94ed-1561-4511-bbdf-2ed7367cb920" released by "_delete_snapshot" :: held 2.516s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" released by "delete_snapshot" :: held 2.552s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:05 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Created reservations ['507fd424-5d9f-4f55-b62e-3c4031a1dcad', 'a31e7cb2-6407-44e1-a06d-4bf78c74dc4c', 'e534e01d-c320-4c17-90a5-4422265f38c4', '58cb5543-b397-4dcc-b496-5591b7f2af12'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:20:05 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Delete snapshot completed successfully. Aug 28 20:20:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-168b3af4-cf60-41d4-a923-427605b9fd32 tempest-SnapshotsActionsTest-997536961 None] Lock "cinder-38db94ed-1561-4511-bbdf-2ed7367cb920-delete_snapshot" released by "delete_snapshot" :: held 2.797s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "cinder-299d898c-29b0-4546-82fe-25639b6a6fee-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Lock "cinder-299d898c-29b0-4546-82fe-25639b6a6fee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "cinder-quobyte-299d898c-29b0-4546-82fe-25639b6a6fee" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Lock "cinder-quobyte-299d898c-29b0-4546-82fe-25639b6a6fee" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Deleting offline snapshot 299d898c-29b0-4546-82fe-25639b6a6fee of volume c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] snapshot_file for this snap is: volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3d565c-0b83-42f2-ade8-86445d704948]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:06 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:20:06 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:06 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:20:06 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:07 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.607s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c636b541-810f-40ac-87f8-d8d0849c7dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:20:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eb24a9-1b95-45af-8a44-0bc25ba797df]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:07 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.638s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:20:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:20:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:20:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:20:07 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda Aug 28 20:20:07 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:08 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda" returned: 0 in 0.928s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:08 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:20:08 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:08 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.674s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:08 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee Aug 28 20:20:08 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Flow 'volume_create_manager' (06ecc818-4d0c-45ea-a834-ee9915415e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb4b6f0-72ad-445a-adf9-f4d07a41e548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb4b6f0-72ad-445a-adf9-f4d07a41e548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-804691508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e2879a-6acf-4f46-bd8b-2e883bbe36d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2b64396a204fb98e6afaca320a1e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:20:09Z,use_quota=True,user_id='b1636d27030c4f2aa7051e357eb2d4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86aee297-4c93-4c9a-a6ee-aaa90fbadeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86aee297-4c93-4c9a-a6ee-aaa90fbadeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67625b36-3fa5-45cb-a7a4-bf0751a14156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67625b36-3fa5-45cb-a7a4-bf0751a14156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e2879a-6acf-4f46-bd8b-2e883bbe36d1', 'volume_name': 'volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b684176-e1d7-4802-854b-751085faf1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b684176-e1d7-4802-854b-751085faf1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668d517e-c356-4421-91c5-c1c3675d1ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:09 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Volume 99e2879a-6acf-4f46-bd8b-2e883bbe36d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1', 'volume_size': 1} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-804691508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e2879a-6acf-4f46-bd8b-2e883bbe36d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2b64396a204fb98e6afaca320a1e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:20:09Z,use_quota=True,user_id='b1636d27030c4f2aa7051e357eb2d4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Creating volume 99e2879a-6acf-4f46-bd8b-2e883bbe36d1 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:20:09 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:09 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 1073741824 Aug 28 20:20:09 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:09 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda.299d898c-29b0-4546-82fe-25639b6a6fee" returned: 0 in 0.778s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Lock "cinder-quobyte-299d898c-29b0-4546-82fe-25639b6a6fee" released by "_delete_snapshot" :: held 3.201s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" released by "delete_snapshot" :: held 3.239s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Created reservations ['e6c6542c-0bdb-46c3-8c56-5b28942d3002', 'c19aa19a-b160-479a-834b-94e232ca0313', '9dcbb519-daf6-41e6-8a31-fc74272b7c90', 'fc372817-dabe-473c-965b-6c98a2fdea93'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:20:09 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Delete snapshot completed successfully. Aug 28 20:20:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-283626d3-5cb4-499d-9748-3f8bab6d18f1 tempest-SnapshotsActionsTest-1865766585 None] Lock "cinder-299d898c-29b0-4546-82fe-25639b6a6fee-delete_snapshot" released by "delete_snapshot" :: held 3.580s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:10 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 1073741824" returned: 0 in 0.902s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:10 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 Aug 28 20:20:10 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:10 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1" returned: 0 in 0.348s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668d517e-c356-4421-91c5-c1c3675d1ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1d09c0-90f8-44a1-899b-0719bc247fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:10 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Volume volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 (99e2879a-6acf-4f46-bd8b-2e883bbe36d1): created successfully Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1d09c0-90f8-44a1-899b-0719bc247fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Flow 'volume_create_manager' (06ecc818-4d0c-45ea-a834-ee9915415e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:20:10 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f1bbe365-3a96-47cf-b514-814993bc826a tempest-TestImageHashVerification-1048682728 None] Created volume successfully. Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "cinder-c636b541-810f-40ac-87f8-d8d0849c7dda-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Lock "cinder-c636b541-810f-40ac-87f8-d8d0849c7dda-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:11 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51b3421-de77-4db2-b99a-75a709d9e24d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:11 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda Aug 28 20:20:11 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:11 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda" returned: 0 in 0.806s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:11 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda Aug 28 20:20:11 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:12 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c636b541-810f-40ac-87f8-d8d0849c7dda" returned: 0 in 0.535s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Lock "cinder-quobyte-c636b541-810f-40ac-87f8-d8d0849c7dda" released by "delete_volume" :: held 1.469s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:12 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Created reservations ['4f2354c6-28c4-4241-8c99-3f6c5dd243f0', 'ac8cec12-7788-4c4f-8585-c2a91a5e4d18', '51129efb-91bb-4745-85cb-e1353955f92e', 'db704d0d-ff6b-47ce-98fe-2956eccd6fee'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:20:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:20:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:20:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:12 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:20:12 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:13 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.379s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:13 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:20:13 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Deleted volume successfully. Aug 28 20:20:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-386d237b-7895-4850-9624-2590d3d90c53 tempest-SnapshotsActionsTest-1865766585 None] Lock "cinder-c636b541-810f-40ac-87f8-d8d0849c7dda-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:13 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f86601-c421-4c1d-b1e3-0f9b6160bba7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:13 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 Aug 28 20:20:13 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:13 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1" returned: 0 in 0.572s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:13 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4f8424-84c4-4049-bd44-d4ed85bf812b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:14 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 Aug 28 20:20:14 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:14 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1" returned: 0 in 0.680s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 /opt/stack/data/cinder/conversion/99e2879a-6acf-4f46-bd8b-2e883bbe36d1.temp_image.d97d64c8-1122-42be-83a8-36b8c3c7621831_q_z6q.img {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:14 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 /opt/stack/data/cinder/conversion/99e2879a-6acf-4f46-bd8b-2e883bbe36d1.temp_image.d97d64c8-1122-42be-83a8-36b8c3c7621831_q_z6q.img Aug 28 20:20:14 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:21 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 /opt/stack/data/cinder/conversion/99e2879a-6acf-4f46-bd8b-2e883bbe36d1.temp_image.d97d64c8-1122-42be-83a8-36b8c3c7621831_q_z6q.img" returned: 0 in 7.270s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:21 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e849a23-d1db-46a9-9f1e-627dd5b6fc94]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:22 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 Aug 28 20:20:22 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:22 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1" returned: 0 in 0.602s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:22 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1, size 1024.00 MB, duration 7.27 sec, destination /opt/stack/data/cinder/conversion/99e2879a-6acf-4f46-bd8b-2e883bbe36d1.temp_image.d97d64c8-1122-42be-83a8-36b8c3c7621831_q_z6q.img {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:20:22 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Converted 1024.00 MB image at 140.83 MB/s Aug 28 20:20:22 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] d97d64c8-1122-42be-83a8-36b8c3c76218 was raw, no need to convert to raw {{(pid=86028) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Flow 'volume_create_manager' (95de0fb3-fb44-4ad3-ad59-e9c94e13c7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbf2ace-7532-46ac-a3f4-5e52ed779cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbf2ace-7532-46ac-a3f4-5e52ed779cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1755619782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409243ad-8bbd-4ec2-ba2f-62112c70ebc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3146e067524f97bbacbcc2ec553331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:20:28Z,use_quota=True,user_id='75cc80a6f9eb492fbee1600e83975c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cfd691-c33c-45f0-8ace-f4017d7ff093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cfd691-c33c-45f0-8ace-f4017d7ff093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bdf99be-2254-4c8d-9240-e1243bc3e30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bdf99be-2254-4c8d-9240-e1243bc3e30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409243ad-8bbd-4ec2-ba2f-62112c70ebc2', 'volume_name': 'volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96978f88-a6db-407e-9f88-5d656c79b5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96978f88-a6db-407e-9f88-5d656c79b5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e78031-6c3a-421d-a46f-eaa782ed115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:28 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Volume 409243ad-8bbd-4ec2-ba2f-62112c70ebc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2', 'volume_size': 1} Aug 28 20:20:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-0a14211d-fbec-4534-9424-e102a44090c1 req-de030d9d-4d95-413b-b71f-5fb448d1d6df tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:38 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=63,cinder:SELECT=62,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:20:41 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=76,cinder:UPDATE=57,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Flow 'volume_create_manager' (79e70f2e-af70-4207-baed-1a28463d4aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377a484d-5723-4078-88f1-8ef9eb391a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377a484d-5723-4078-88f1-8ef9eb391a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1775391619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f4642d-25e4-4293-a79a-c18501ee528c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992915b3d60f42a9b727149267038745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:20:45Z,use_quota=True,user_id='a62655026837455e9bb59d205d2153dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619d528f-1749-441e-b464-50c297f02d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619d528f-1749-441e-b464-50c297f02d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb116466-7493-40f9-979c-d28e89e89d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb116466-7493-40f9-979c-d28e89e89d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f4642d-25e4-4293-a79a-c18501ee528c', 'volume_name': 'volume-e6f4642d-25e4-4293-a79a-c18501ee528c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3bd31f-96fb-4ba5-a441-9b0a5fe380fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3bd31f-96fb-4ba5-a441-9b0a5fe380fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5d874c-b3bf-4e78-85bd-30bbe4bfb3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:44 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Volume e6f4642d-25e4-4293-a79a-c18501ee528c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f4642d-25e4-4293-a79a-c18501ee528c', 'volume_size': 1} Aug 28 20:20:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.775s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Uploaded volume to glance image-id: d97d64c8-1122-42be-83a8-36b8c3c76218. {{(pid=86028) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.522s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1755619782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409243ad-8bbd-4ec2-ba2f-62112c70ebc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3146e067524f97bbacbcc2ec553331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:20:28Z,use_quota=True,user_id='75cc80a6f9eb492fbee1600e83975c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Creating volume 409243ad-8bbd-4ec2-ba2f-62112c70ebc2 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:20:45 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:45 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2 1073741824 Aug 28 20:20:45 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-86c38314-d165-4ac3-b790-8fa63e009b0b tempest-TestImageHashVerification-1048682728 None] Copy volume to image completed successfully. Aug 28 20:20:45 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2 1073741824" returned: 0 in 0.404s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:45 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2 Aug 28 20:20:45 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:45 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2" returned: 0 in 0.259s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-0a14211d-fbec-4534-9424-e102a44090c1 req-de030d9d-4d95-413b-b71f-5fb448d1d6df tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.763s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e78031-6c3a-421d-a46f-eaa782ed115c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f417fd5-89e0-4e0b-a256-92bd5aea101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-0a14211d-fbec-4534-9424-e102a44090c1 req-de030d9d-4d95-413b-b71f-5fb448d1d6df tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1775391619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f4642d-25e4-4293-a79a-c18501ee528c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992915b3d60f42a9b727149267038745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:20:45Z,use_quota=True,user_id='a62655026837455e9bb59d205d2153dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Creating volume e6f4642d-25e4-4293-a79a-c18501ee528c {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:20:45 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:45 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c 1073741824 Aug 28 20:20:45 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Volume volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2 (409243ad-8bbd-4ec2-ba2f-62112c70ebc2): created successfully Aug 28 20:20:45 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f417fd5-89e0-4e0b-a256-92bd5aea101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Flow 'volume_create_manager' (95de0fb3-fb44-4ad3-ad59-e9c94e13c7c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:20:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1e9c3a00-d957-4985-be68-82dc56b1c765 tempest-VolumeQuotasAdminTestJSON-636640314 None] Created volume successfully. Aug 28 20:20:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-0a14211d-fbec-4534-9424-e102a44090c1 req-de030d9d-4d95-413b-b71f-5fb448d1d6df tempest-TestInstancesWithCinderVolumes-25371545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-402866d3-c527-49e7-aa38-392b07a14ee6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec1e3bad-b346-457a-9f6b-0007b5be9ab4', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:20:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-0a14211d-fbec-4534-9424-e102a44090c1 req-de030d9d-4d95-413b-b71f-5fb448d1d6df tempest-TestInstancesWithCinderVolumes-25371545 None] attachment_update completed successfully. Aug 28 20:20:46 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c 1073741824" returned: 0 in 0.513s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:46 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c Aug 28 20:20:46 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:46 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c" returned: 0 in 0.289s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5d874c-b3bf-4e78-85bd-30bbe4bfb3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f4642d-25e4-4293-a79a-c18501ee528c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd50fe48-981a-4b26-a874-9ea90ec8823d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:46 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Volume volume-e6f4642d-25e4-4293-a79a-c18501ee528c (e6f4642d-25e4-4293-a79a-c18501ee528c): created successfully Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd50fe48-981a-4b26-a874-9ea90ec8823d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Flow 'volume_create_manager' (79e70f2e-af70-4207-baed-1a28463d4aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:20:46 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fe6d5c26-3826-461b-8bad-da8592f60ad6 tempest-AttachVolumeNegativeTest-868475344 None] Created volume successfully. Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Acquiring lock "cinder-99e2879a-6acf-4f46-bd8b-2e883bbe36d1-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Lock "cinder-99e2879a-6acf-4f46-bd8b-2e883bbe36d1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Acquiring lock "cinder-quobyte-99e2879a-6acf-4f46-bd8b-2e883bbe36d1" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Lock "cinder-quobyte-99e2879a-6acf-4f46-bd8b-2e883bbe36d1" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abb474a-3037-4c39-801d-e9edf5a7b68d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Acquiring lock "cinder-409243ad-8bbd-4ec2-ba2f-62112c70ebc2-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:47 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 Aug 28 20:20:47 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "cinder-409243ad-8bbd-4ec2-ba2f-62112c70ebc2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Acquiring lock "cinder-quobyte-409243ad-8bbd-4ec2-ba2f-62112c70ebc2" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "cinder-quobyte-409243ad-8bbd-4ec2-ba2f-62112c70ebc2" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[6796c04f-c4cb-40dd-82c0-d4319f934194]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:47 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2 Aug 28 20:20:47 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:47 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1" returned: 0 in 0.518s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:47 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1 Aug 28 20:20:47 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:47 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2" returned: 0 in 0.463s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:47 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2 Aug 28 20:20:47 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:47 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-99e2879a-6acf-4f46-bd8b-2e883bbe36d1" returned: 0 in 0.361s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Lock "cinder-quobyte-99e2879a-6acf-4f46-bd8b-2e883bbe36d1" released by "delete_volume" :: held 0.935s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Created reservations ['63de8b48-b26f-429b-97d6-b3cdc202478a', 'a4df6a6e-ce85-401d-b9c3-ef6889c5d65d', '9c0670b0-adad-4b80-b4a8-23c884629182', 'c1533b27-112b-40c6-a5c3-7447bccd4dcf'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:20:47 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-409243ad-8bbd-4ec2-ba2f-62112c70ebc2" returned: 0 in 0.304s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-eec66bfa-ca7c-4464-a66e-b808eb52b424 req-ef34e43a-e7ed-42db-9521-d0cd46404f4d tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-eec66bfa-ca7c-4464-a66e-b808eb52b424 req-ef34e43a-e7ed-42db-9521-d0cd46404f4d tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "cinder-quobyte-409243ad-8bbd-4ec2-ba2f-62112c70ebc2" released by "delete_volume" :: held 0.846s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-eec66bfa-ca7c-4464-a66e-b808eb52b424 req-ef34e43a-e7ed-42db-9521-d0cd46404f4d tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-eec66bfa-ca7c-4464-a66e-b808eb52b424 req-ef34e43a-e7ed-42db-9521-d0cd46404f4d tempest-AttachVolumeNegativeTest-868475344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-e6f4642d-25e4-4293-a79a-c18501ee528c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4a6cb46-8872-4d37-a0d3-c9412caf979a', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:20:48 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:20:48 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Created reservations ['31fbb40c-4294-45e4-82a8-ba6e6b10ffa3', '26837140-069c-46a5-a25c-7374bdec5b0c', '20233ae0-e198-47e3-8bb7-9b0398a2bb74', '75c62fef-b456-41f0-8586-c3e3e30b51cf'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:20:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-eec66bfa-ca7c-4464-a66e-b808eb52b424 req-ef34e43a-e7ed-42db-9521-d0cd46404f4d tempest-AttachVolumeNegativeTest-868475344 None] attachment_update completed successfully. Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:48 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:20:48 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:48 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.358s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:20:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Deleted volume successfully. Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e8e2ec4-8b45-43b9-aaa1-2bdf53d262fd tempest-TestImageHashVerification-1048682728 None] Lock "cinder-99e2879a-6acf-4f46-bd8b-2e883bbe36d1-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:48 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.389s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:20:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Deleted volume successfully. Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c25a449e-6e81-4a99-acbc-2d6daa4ecf83 tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "cinder-409243ad-8bbd-4ec2-ba2f-62112c70ebc2-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-29e066d6-cb2f-4e08-a222-926014a02a59 req-c43fb15f-e1ad-4f3a-990e-33ae826e0245 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-29e066d6-cb2f-4e08-a222-926014a02a59 req-c43fb15f-e1ad-4f3a-990e-33ae826e0245 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-29e066d6-cb2f-4e08-a222-926014a02a59 req-c43fb15f-e1ad-4f3a-990e-33ae826e0245 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-29e066d6-cb2f-4e08-a222-926014a02a59 req-c43fb15f-e1ad-4f3a-990e-33ae826e0245 tempest-TestInstancesWithCinderVolumes-25371545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-ec5a759a-0eea-4290-ae55-ed885bc86844', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5dca42d-c8a9-4c22-929c-48ebe899fbe3', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:20:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-29e066d6-cb2f-4e08-a222-926014a02a59 req-c43fb15f-e1ad-4f3a-990e-33ae826e0245 tempest-TestInstancesWithCinderVolumes-25371545 None] attachment_update completed successfully. Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Flow 'volume_create_manager' (9573fb09-d3d7-4686-bf21-424db4fdedee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ffa431-9a32-4dc2-9283-53a3cd52d935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ffa431-9a32-4dc2-9283-53a3cd52d935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1800937303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbf73f1-5285-4182-90f7-910cc4e590bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3146e067524f97bbacbcc2ec553331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:20:49Z,use_quota=True,user_id='75cc80a6f9eb492fbee1600e83975c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b95637-9b80-4fc3-bd76-c92e473b81ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b95637-9b80-4fc3-bd76-c92e473b81ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fa6314-7c9b-40a8-97ce-7323dc9cdec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fa6314-7c9b-40a8-97ce-7323dc9cdec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bbf73f1-5285-4182-90f7-910cc4e590bb', 'volume_name': 'volume-2bbf73f1-5285-4182-90f7-910cc4e590bb', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b49be58-e453-4dc6-8848-9160b1976efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b49be58-e453-4dc6-8848-9160b1976efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2265a78a-ad7c-4146-bf3a-0749b631aa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:49 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Volume 2bbf73f1-5285-4182-90f7-910cc4e590bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bbf73f1-5285-4182-90f7-910cc4e590bb', 'volume_size': 1} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1800937303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bbf73f1-5285-4182-90f7-910cc4e590bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3146e067524f97bbacbcc2ec553331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:20:49Z,use_quota=True,user_id='75cc80a6f9eb492fbee1600e83975c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Creating volume 2bbf73f1-5285-4182-90f7-910cc4e590bb {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:20:49 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:49 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb 1073741824 Aug 28 20:20:49 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:49 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb 1073741824" returned: 0 in 0.513s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:49 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb Aug 28 20:20:49 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:49 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb" returned: 0 in 0.303s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:20:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2265a78a-ad7c-4146-bf3a-0749b631aa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bbf73f1-5285-4182-90f7-910cc4e590bb', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05e242a-a3e3-43ab-a42d-944b931908df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:20:50 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Volume volume-2bbf73f1-5285-4182-90f7-910cc4e590bb (2bbf73f1-5285-4182-90f7-910cc4e590bb): created successfully Aug 28 20:20:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05e242a-a3e3-43ab-a42d-944b931908df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:20:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Flow 'volume_create_manager' (9573fb09-d3d7-4686-bf21-424db4fdedee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:20:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-13376edd-865a-4f76-a4b1-9e0ac2af133a tempest-VolumeQuotasAdminTestJSON-636640314 None] Created volume successfully. Aug 28 20:20:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-5b63ebea-0df2-4273-b4e8-2b70e12ef0cd req-276b29ae-1fff-40f3-8811-c59bf29c126e tempest-AttachVolumeNegativeTest-868475344 None] Terminate volume connection completed successfully. Aug 28 20:20:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-5b63ebea-0df2-4273-b4e8-2b70e12ef0cd req-276b29ae-1fff-40f3-8811-c59bf29c126e tempest-AttachVolumeNegativeTest-868475344 None] Deleting attachment d4a6cb46-8872-4d37-a0d3-c9412caf979a. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:20:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1003f001-4cb9-448c-977b-0ec208be4a32 tempest-VolumeQuotasAdminTestJSON-1469563685 None] Transfer volume completed successfully. Aug 28 20:20:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Acquiring lock "cinder-2bbf73f1-5285-4182-90f7-910cc4e590bb-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Lock "cinder-2bbf73f1-5285-4182-90f7-910cc4e590bb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Acquiring lock "cinder-quobyte-2bbf73f1-5285-4182-90f7-910cc4e590bb" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Lock "cinder-quobyte-2bbf73f1-5285-4182-90f7-910cc4e590bb" acquired by "delete_volume" :: waited 0.026s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:52 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1050cb-df80-47f6-841a-62f4846d2dca]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:53 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb Aug 28 20:20:53 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:53 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb" returned: 0 in 0.601s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:53 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb Aug 28 20:20:53 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:53 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2bbf73f1-5285-4182-90f7-910cc4e590bb" returned: 0 in 0.329s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Lock "cinder-quobyte-2bbf73f1-5285-4182-90f7-910cc4e590bb" released by "delete_volume" :: held 0.995s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:53 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Created reservations ['943d1930-e74b-4629-86cf-ccc4791fbd8c', 'ce7f2e7c-2156-47e8-af89-fd801f2df563', 'ea8289dd-6846-4c05-8b48-be2863864706', '4f421ede-e1c9-43fe-a7da-d2e8b7c870da'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:20:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:20:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:20:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:54 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:20:54 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:54 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.300s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:54 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:20:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Deleted volume successfully. Aug 28 20:20:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-47e33a55-3913-4d43-bc95-f02c1a47e4ca tempest-VolumeQuotasAdminTestJSON-2100997277 None] Lock "cinder-2bbf73f1-5285-4182-90f7-910cc4e590bb-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-bd4ba3bc-66fb-4469-99c2-8cc4e523e1df req-fc9494e0-709b-4dd3-8b77-d896cbc95af0 tempest-TestInstancesWithCinderVolumes-25371545 None] Terminate volume connection completed successfully. Aug 28 20:20:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-bd4ba3bc-66fb-4469-99c2-8cc4e523e1df req-fc9494e0-709b-4dd3-8b77-d896cbc95af0 tempest-TestInstancesWithCinderVolumes-25371545 None] Deleting attachment ec1e3bad-b346-457a-9f6b-0007b5be9ab4. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:20:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "cinder-402866d3-c527-49e7-aa38-392b07a14ee6-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-402866d3-c527-49e7-aa38-392b07a14ee6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "cinder-quobyte-402866d3-c527-49e7-aa38-392b07a14ee6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:20:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-quobyte-402866d3-c527-49e7-aa38-392b07a14ee6" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:20:56 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d1edc7-48ef-4e70-80dd-9b8d4f821d04]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:20:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:56 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6 Aug 28 20:20:56 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:56 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6" returned: 0 in 0.577s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:56 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6 Aug 28 20:20:56 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:57 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-402866d3-c527-49e7-aa38-392b07a14ee6" returned: 0 in 0.348s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-quobyte-402866d3-c527-49e7-aa38-392b07a14ee6" released by "delete_volume" :: held 0.989s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:20:57 devstack cinder-volume[86028]: WARNING cinder.quota [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-845813496-433361391 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-845813496-433361391, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:20:57 devstack cinder-volume[86028]: WARNING cinder.quota [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-845813496-433361391 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-845813496-433361391, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Created reservations ['30e57284-56a8-47e2-aa34-11fe4dc1925b', 'e5dcfe9c-b872-43ff-bed9-e100864b6acf', 'cf6e0338-7151-42e7-986d-7891d1a5422d', '264b3ee0-8012-4381-9e0b-4432db1655fc'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:20:57 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:20:57 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:20:57 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.312s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:20:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Deleted volume successfully. Aug 28 20:20:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2d41ce55-fd88-4b8b-885d-7ee2a6a0bb61 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-402866d3-c527-49e7-aa38-392b07a14ee6-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:00 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-6e25d96f-f6a6-447d-9b9c-8fbbaf6cf31f req-15d2bd30-b20a-4279-84ea-56bbae7a12a1 tempest-TestInstancesWithCinderVolumes-25371545 None] Terminate volume connection completed successfully. Aug 28 20:21:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-6e25d96f-f6a6-447d-9b9c-8fbbaf6cf31f req-15d2bd30-b20a-4279-84ea-56bbae7a12a1 tempest-TestInstancesWithCinderVolumes-25371545 None] Deleting attachment f5dca42d-c8a9-4c22-929c-48ebe899fbe3. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:21:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "cinder-ec5a759a-0eea-4290-ae55-ed885bc86844-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-ec5a759a-0eea-4290-ae55-ed885bc86844-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "cinder-quobyte-ec5a759a-0eea-4290-ae55-ed885bc86844" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-quobyte-ec5a759a-0eea-4290-ae55-ed885bc86844" acquired by "delete_volume" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:01 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[403c9748-ba77-4e91-8bbe-943a26d7267e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:01 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844 Aug 28 20:21:01 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:01 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844" returned: 0 in 0.567s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:01 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844 Aug 28 20:21:01 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:02 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ec5a759a-0eea-4290-ae55-ed885bc86844" returned: 0 in 0.331s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-quobyte-ec5a759a-0eea-4290-ae55-ed885bc86844" released by "delete_volume" :: held 0.965s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:02 devstack cinder-volume[86028]: WARNING cinder.quota [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1283726377-122489552 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1283726377-122489552, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:21:02 devstack cinder-volume[86028]: WARNING cinder.quota [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1283726377-122489552 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1283726377-122489552, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Created reservations ['0184c4e2-c35e-4ca3-9d75-039cb751fddb', '91443c0c-55ba-4ea5-8b41-8f2b9de8f0e0', '7ef534ce-256e-41f2-a628-4b945dbddcf5', 'a0e2c420-8954-45db-99d1-0339aa6e3a7b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:02 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:02 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:02 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.431s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Deleted volume successfully. Aug 28 20:21:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db200306-5f57-40b7-9433-8708727082b1 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-ec5a759a-0eea-4290-ae55-ed885bc86844-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:06 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-9bf8f1e6-c7bd-4f63-91a8-2ceceab55e82 req-242938b9-9fb7-41d0-bd46-059501c52ae3 tempest-TestInstancesWithCinderVolumes-25371545 None] Terminate volume connection completed successfully. Aug 28 20:21:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-9bf8f1e6-c7bd-4f63-91a8-2ceceab55e82 req-242938b9-9fb7-41d0-bd46-059501c52ae3 tempest-TestInstancesWithCinderVolumes-25371545 None] Deleting attachment f4e5a527-9b53-4b5d-b510-1c6ba5bd3761. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:21:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:21:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:06 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:06 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:07 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.341s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Flow 'volume_create_manager' (15dee25c-fcbc-48f5-9c4c-e1adc9232ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0578b5a-0fa7-42c0-bd1e-0fa411cc99a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0578b5a-0fa7-42c0-bd1e-0fa411cc99a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1726208918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c435b8b267da40a7995e06a360fee729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:07Z,use_quota=True,user_id='7c7c9c829ca9495fb7885c25e420b0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ac18367-d161-428b-a888-d23b3ba41ebf),volume_type_id=3ac18367-d161-428b-a888-d23b3ba41ebf)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af94e238-23c7-47dc-a28f-0bb700c73a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af94e238-23c7-47dc-a28f-0bb700c73a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4817e19-9ea4-4c2a-b4af-afe418809ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4817e19-9ea4-4c2a-b4af-afe418809ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6', 'volume_name': 'volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1969fe-981a-4da3-801d-9b7d41153e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1969fe-981a-4da3-801d-9b7d41153e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af0f052-2641-43da-be82-5130e5c912de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:07 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Volume b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6', 'volume_size': 1} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1726208918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c435b8b267da40a7995e06a360fee729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:07Z,use_quota=True,user_id='7c7c9c829ca9495fb7885c25e420b0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ac18367-d161-428b-a888-d23b3ba41ebf),volume_type_id=3ac18367-d161-428b-a888-d23b3ba41ebf)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Creating volume b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:07 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:07 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 1073741824 Aug 28 20:21:07 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:08 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 1073741824" returned: 0 in 0.685s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:08 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 Aug 28 20:21:08 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:08 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "cinder-b63eadac-7447-4a78-8d02-d5c6d58b7a47-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6" returned: 0 in 0.425s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af0f052-2641-43da-be82-5130e5c912de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fe68c9-e9eb-43e8-ac52-e5ed2fcf25c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-b63eadac-7447-4a78-8d02-d5c6d58b7a47-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:08 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Volume volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 (b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6): created successfully Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fe68c9-e9eb-43e8-ac52-e5ed2fcf25c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Flow 'volume_create_manager' (15dee25c-fcbc-48f5-9c4c-e1adc9232ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:08 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c3764cc5-241d-4c53-92f1-6b1c4714a30a tempest-VolumeTypesAccessTest-285645322 None] Created volume successfully. Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "cinder-quobyte-b63eadac-7447-4a78-8d02-d5c6d58b7a47" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-quobyte-b63eadac-7447-4a78-8d02-d5c6d58b7a47" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4e307e-f98d-4ede-83d9-e36526bdf4b9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:09 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 Aug 28 20:21:09 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:09 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47" returned: 0 in 0.406s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:09 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47 Aug 28 20:21:09 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Acquiring lock "cinder-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Lock "cinder-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Acquiring lock "cinder-quobyte-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Lock "cinder-quobyte-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1491e478-cf1e-4de6-bcc8-019dba72e786]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:09 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b63eadac-7447-4a78-8d02-d5c6d58b7a47" returned: 0 in 0.387s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-quobyte-b63eadac-7447-4a78-8d02-d5c6d58b7a47" released by "delete_volume" :: held 0.852s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:09 devstack cinder-volume[86028]: WARNING cinder.quota [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1693897607-513462013 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1693897607-513462013, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:21:09 devstack cinder-volume[86028]: WARNING cinder.quota [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1693897607-513462013 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1693897607-513462013, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Created reservations ['8f35a63c-b6bd-4e2f-ba2d-827321af7ed4', '0ceba89d-79ef-4d18-8bb0-f97e257a7943', 'd97bf055-2e2b-41e9-a3bb-c245ccd0463c', 'f2910ed0-25d1-485e-b55b-d1b88bc9d794'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:09 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 Aug 28 20:21:09 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:09 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:09 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:10 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.375s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:10 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Deleted volume successfully. Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6a187b02-c672-4074-afc5-75074336cbd5 tempest-TestInstancesWithCinderVolumes-25371545 None] Lock "cinder-b63eadac-7447-4a78-8d02-d5c6d58b7a47-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:10 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6" returned: 0 in 0.644s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:10 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6 Aug 28 20:21:10 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:10 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6" returned: 0 in 0.417s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Lock "cinder-quobyte-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6" released by "delete_volume" :: held 1.113s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:10 devstack cinder-volume[86028]: WARNING cinder.quota [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2144604352 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2144604352, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:21:10 devstack cinder-volume[86028]: WARNING cinder.quota [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2144604352 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2144604352, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Created reservations ['5758979b-adb5-434d-9cba-453f10b63dff', '78166f67-0d9e-4253-abcc-f984eda04eec', '6f844cc1-3e9c-4b69-8fcf-5cb29f45c9d6', 'c6b7685b-1b3a-486e-b229-211661e57ebc'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:11 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:11 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:11 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.525s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:11 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:11 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Deleted volume successfully. Aug 28 20:21:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a5037a1-0fbe-4f1c-8a3f-559d737abca1 tempest-VolumeTypesAccessTest-285645322 None] Lock "cinder-b383d0e2-a9cf-4cc5-81e2-38cf1028cbf6-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:20 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=63,cinder:UPDATE=71,cinder:INSERT=15,cinder:DELETE=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:21:21 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=68,cinder:UPDATE=74,cinder:DELETE=9,cinder:INSERT=17 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (3f0eb39a-8ada-46eb-9370-a1c47f3f642d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95397fc-1cbd-41e2-b2e7-df23494edf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95397fc-1cbd-41e2-b2e7-df23494edf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-167776333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceab9956-e1fe-48c5-ad03-9e7b20bd5968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:28Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ef55ad-0b3b-44d9-9075-6317acddafc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ef55ad-0b3b-44d9-9075-6317acddafc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a835c90d-a097-4d3d-bdaf-fd3fe2f7b39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a835c90d-a097-4d3d-bdaf-fd3fe2f7b39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceab9956-e1fe-48c5-ad03-9e7b20bd5968', 'volume_name': 'volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403f23e3-d503-4a79-a6ca-252f60def9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403f23e3-d503-4a79-a6ca-252f60def9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb88078-0f44-4423-b7ff-f2c7c1944656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:27 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume ceab9956-e1fe-48c5-ad03-9e7b20bd5968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968', 'volume_size': 1} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-167776333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceab9956-e1fe-48c5-ad03-9e7b20bd5968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:28Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Creating volume ceab9956-e1fe-48c5-ad03-9e7b20bd5968 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:27 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:27 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968 1073741824 Aug 28 20:21:27 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:28 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968 1073741824" returned: 0 in 0.432s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:28 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968 Aug 28 20:21:28 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:28 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb88078-0f44-4423-b7ff-f2c7c1944656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50365ce5-0bd0-439d-a7b0-a838598c1290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:28 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968 (ceab9956-e1fe-48c5-ad03-9e7b20bd5968): created successfully Aug 28 20:21:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50365ce5-0bd0-439d-a7b0-a838598c1290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (3f0eb39a-8ada-46eb-9370-a1c47f3f642d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c962e37d-b545-4954-b492-682e2042b847 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created volume successfully. Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (1ee7c20a-3f64-4baa-ada7-169fa5fb5208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe36e644-3f17-4c4a-b7ab-b1ade5e67d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe36e644-3f17-4c4a-b7ab-b1ade5e67d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1463010846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f44f7c4-ddad-4b18-9357-c4a7df7f74f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:29Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5089f73-fcb6-4c26-9602-d188611783ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5089f73-fcb6-4c26-9602-d188611783ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44cf58e-a845-46ca-bb62-cadf6de2c4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44cf58e-a845-46ca-bb62-cadf6de2c4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f44f7c4-ddad-4b18-9357-c4a7df7f74f6', 'volume_name': 'volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714e5a87-1dec-43fb-8e48-5f844033c35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714e5a87-1dec-43fb-8e48-5f844033c35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321d1cd0-866e-4010-b6dc-f0459ee6292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:29 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume 0f44f7c4-ddad-4b18-9357-c4a7df7f74f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6', 'volume_size': 1} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1463010846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f44f7c4-ddad-4b18-9357-c4a7df7f74f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:29Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Creating volume 0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:29 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:29 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 1073741824 Aug 28 20:21:29 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (a3dc1c3e-82fe-4f52-b52d-0587fc103e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f6cdcb-1f23-4103-947b-250d4c15b99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f6cdcb-1f23-4103-947b-250d4c15b99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288382578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662c4dab-cc74-4231-a7ea-1392fdfc37d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:29Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0442bc-32ef-48e4-ac54-65e96c821bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0442bc-32ef-48e4-ac54-65e96c821bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de0e917-fbf8-4022-8735-b4b76ba59ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de0e917-fbf8-4022-8735-b4b76ba59ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662c4dab-cc74-4231-a7ea-1392fdfc37d2', 'volume_name': 'volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609233b1-1b41-4a72-8d90-eae4f221214d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609233b1-1b41-4a72-8d90-eae4f221214d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e5831f-b69f-4fd2-a75a-0ca5f058cba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:29 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume 662c4dab-cc74-4231-a7ea-1392fdfc37d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2', 'volume_size': 1} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:29 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 1073741824" returned: 0 in 0.571s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:29 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 Aug 28 20:21:29 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:29 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (ab857e76-0f59-493e-b01c-54e04d53622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b593f49-7d35-45c8-9e5e-68db43e9d9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b593f49-7d35-45c8-9e5e-68db43e9d9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519862131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8a49a5-c25f-4a07-b316-64d863af5ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:30Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad8d060-0177-43c3-9dd1-7fa608a29d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad8d060-0177-43c3-9dd1-7fa608a29d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa2fecc-bbe7-45fb-a1d8-7718843ed6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa2fecc-bbe7-45fb-a1d8-7718843ed6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8a49a5-c25f-4a07-b316-64d863af5ff9', 'volume_name': 'volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c098822b-a399-4924-915e-385f700d9493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c098822b-a399-4924-915e-385f700d9493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b97583-f1f4-4e19-bfc1-a061f10e26ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume 0f8a49a5-c25f-4a07-b316-64d863af5ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9', 'volume_size': 1} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:30 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6" returned: 0 in 0.333s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-288382578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662c4dab-cc74-4231-a7ea-1392fdfc37d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:29Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Creating volume 662c4dab-cc74-4231-a7ea-1392fdfc37d2 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:30 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321d1cd0-866e-4010-b6dc-f0459ee6292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb060a4-64c8-4a84-9618-c761e2dc9936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2 1073741824 Aug 28 20:21:30 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 (0f44f7c4-ddad-4b18-9357-c4a7df7f74f6): created successfully Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb060a4-64c8-4a84-9618-c761e2dc9936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (1ee7c20a-3f64-4baa-ada7-169fa5fb5208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:30 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0dec526f-d2f7-47e0-bbc2-10335fdad496 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created volume successfully. Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (f7014632-c4a2-49ac-9df7-c7ac31be56cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06defdb1-09fc-41e9-acce-390f52560b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06defdb1-09fc-41e9-acce-390f52560b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1512927623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903c8e22-2655-426b-ac9c-043202641c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:30Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196f1234-bb9e-4118-9506-44b1c1642f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196f1234-bb9e-4118-9506-44b1c1642f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52347f2-59b9-4921-b6de-1db585363b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52347f2-59b9-4921-b6de-1db585363b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903c8e22-2655-426b-ac9c-043202641c71', 'volume_name': 'volume-903c8e22-2655-426b-ac9c-043202641c71', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36b0e49-d456-472e-abac-2aef06d75848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36b0e49-d456-472e-abac-2aef06d75848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd135ec-739e-416f-a7f7-678579970973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume 903c8e22-2655-426b-ac9c-043202641c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903c8e22-2655-426b-ac9c-043202641c71', 'volume_size': 1} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (4dacd960-be0a-4c34-b498-e39c62360530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed92b1c-05c2-452c-80df-300fbb4563ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2 1073741824" returned: 0 in 0.593s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed92b1c-05c2-452c-80df-300fbb4563ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-218529161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc2788c-8adc-4613-ab2e-c38ed1088cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:31Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d709e9-3011-46fa-b50a-e4787c75d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d709e9-3011-46fa-b50a-e4787c75d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f502d6bb-3bea-427d-82b5-360bba4b7e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f502d6bb-3bea-427d-82b5-360bba4b7e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffc2788c-8adc-4613-ab2e-c38ed1088cb6', 'volume_name': 'volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b154b49-2834-47b4-ba06-4515db06f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b154b49-2834-47b4-ba06-4515db06f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead19382-9e7f-449e-83d3-6e63a6c865c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume ffc2788c-8adc-4613-ab2e-c38ed1088cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6', 'volume_size': 1} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:30 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2 Aug 28 20:21:30 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:31 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2" returned: 0 in 0.280s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.070s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519862131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8a49a5-c25f-4a07-b316-64d863af5ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:30Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Creating volume 0f8a49a5-c25f-4a07-b316-64d863af5ff9 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:31 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e5831f-b69f-4fd2-a75a-0ca5f058cba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:31 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9 1073741824 Aug 28 20:21:31 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7affcba7-1e27-4be4-87b8-718f03a90e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:31 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2 (662c4dab-cc74-4231-a7ea-1392fdfc37d2): created successfully Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7affcba7-1e27-4be4-87b8-718f03a90e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (a3dc1c3e-82fe-4f52-b52d-0587fc103e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:31 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e7fcb0a9-b798-4fbd-bad2-01c348861c97 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created volume successfully. Aug 28 20:21:31 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9 1073741824" returned: 0 in 0.432s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:31 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9 Aug 28 20:21:31 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:31 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9" returned: 0 in 0.271s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1512927623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903c8e22-2655-426b-ac9c-043202641c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:30Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Creating volume 903c8e22-2655-426b-ac9c-043202641c71 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:31 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b97583-f1f4-4e19-bfc1-a061f10e26ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4945bb07-33fa-4ec6-adba-fc659cd3d294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:31 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71 1073741824 Aug 28 20:21:31 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:32 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9 (0f8a49a5-c25f-4a07-b316-64d863af5ff9): created successfully Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4945bb07-33fa-4ec6-adba-fc659cd3d294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (ab857e76-0f59-493e-b01c-54e04d53622e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-99be2fac-caca-44b6-a56e-7c120c703faa tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created volume successfully. Aug 28 20:21:32 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71 1073741824" returned: 0 in 0.433s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:32 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71 Aug 28 20:21:32 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:32 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71" returned: 0 in 0.248s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-218529161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc2788c-8adc-4613-ab2e-c38ed1088cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f62b442f2caf4b3a8dd5cde5d379680a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:31Z,use_quota=True,user_id='09e8c5c477ee42e6895e74e3649fd0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Creating volume ffc2788c-8adc-4613-ab2e-c38ed1088cb6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:32 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:32 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6 1073741824 Aug 28 20:21:32 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd135ec-739e-416f-a7f7-678579970973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903c8e22-2655-426b-ac9c-043202641c71', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4a681b-5ff6-4b48-955d-032c929099cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:32 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume volume-903c8e22-2655-426b-ac9c-043202641c71 (903c8e22-2655-426b-ac9c-043202641c71): created successfully Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4a681b-5ff6-4b48-955d-032c929099cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (f7014632-c4a2-49ac-9df7-c7ac31be56cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d18cce10-0d88-4a67-b65f-a3113506e081 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created volume successfully. Aug 28 20:21:33 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6 1073741824" returned: 0 in 0.519s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:33 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6 Aug 28 20:21:33 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:33 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6" returned: 0 in 0.291s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead19382-9e7f-449e-83d3-6e63a6c865c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d758c0bc-d761-41c5-9035-e4cfa49b76ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:33 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Volume volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6 (ffc2788c-8adc-4613-ab2e-c38ed1088cb6): created successfully Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d758c0bc-d761-41c5-9035-e4cfa49b76ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Flow 'volume_create_manager' (4dacd960-be0a-4c34-b498-e39c62360530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-64158590-19fb-4b1d-af71-b50d1117c963 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created volume successfully. Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Flow 'volume_create_manager' (45d4d796-4cbb-4d30-87a9-a76f4dd77c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f51c8c-4b3c-4997-b763-43a8e152b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f51c8c-4b3c-4997-b763-43a8e152b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2064011363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ccd19c-752a-44c6-9d3b-860aed5aa6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2235fa9eb60240888ad71cb068923193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:34Z,use_quota=True,user_id='ade13e431dc841b6b3f8376569ea1fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e61b0f-8b7e-4217-976f-6cc160e47fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e61b0f-8b7e-4217-976f-6cc160e47fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2a2ca1-b431-4172-bbdd-03f94be3909d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2a2ca1-b431-4172-bbdd-03f94be3909d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ccd19c-752a-44c6-9d3b-860aed5aa6db', 'volume_name': 'volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197b1652-2be9-4c39-a457-b9d126ac3d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197b1652-2be9-4c39-a457-b9d126ac3d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1882aa44-22ad-426f-a902-648b490cf198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:33 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Volume a2ccd19c-752a-44c6-9d3b-860aed5aa6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db', 'volume_size': 1} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2064011363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ccd19c-752a-44c6-9d3b-860aed5aa6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2235fa9eb60240888ad71cb068923193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:34Z,use_quota=True,user_id='ade13e431dc841b6b3f8376569ea1fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Creating volume a2ccd19c-752a-44c6-9d3b-860aed5aa6db {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:33 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:33 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db 1073741824 Aug 28 20:21:33 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-ffc2788c-8adc-4613-ab2e-c38ed1088cb6-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-ffc2788c-8adc-4613-ab2e-c38ed1088cb6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-quobyte-ffc2788c-8adc-4613-ab2e-c38ed1088cb6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-ffc2788c-8adc-4613-ab2e-c38ed1088cb6" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d2e9c0-4f8f-4bff-b875-251dcb9806d5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:34 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db 1073741824" returned: 0 in 0.501s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:34 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6 Aug 28 20:21:34 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:34 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db Aug 28 20:21:34 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:34 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" returned: 0 in 0.267s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1882aa44-22ad-426f-a902-648b490cf198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa03b712-45e8-43a9-a14f-2ec8d29163e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:34 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:34 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Volume volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db (a2ccd19c-752a-44c6-9d3b-860aed5aa6db): created successfully Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa03b712-45e8-43a9-a14f-2ec8d29163e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Flow 'volume_create_manager' (45d4d796-4cbb-4d30-87a9-a76f4dd77c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6" returned: 0 in 0.435s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:34 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-49c3d5ce-247c-4571-89c6-db7d13a87b23 tempest-VolumesDeleteCascade-786693839 None] Created volume successfully. Aug 28 20:21:34 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6 Aug 28 20:21:34 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:35 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ffc2788c-8adc-4613-ab2e-c38ed1088cb6" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-ffc2788c-8adc-4613-ab2e-c38ed1088cb6" released by "delete_volume" :: held 0.725s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created reservations ['5a51fca3-6c05-48fe-94b5-77c26f429d45', 'fae97ae8-2084-43e4-84d8-625221bc8e78', '1e285b58-de07-4ce9-9795-7fcac336527c', 'e05b35cf-fb5b-46c9-a942-5110e983779c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:35 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:35 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-903c8e22-2655-426b-ac9c-043202641c71-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-903c8e22-2655-426b-ac9c-043202641c71-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:35 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:35 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Deleted volume successfully. Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-quobyte-903c8e22-2655-426b-ac9c-043202641c71" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-702b2779-e21c-4ddd-91a6-d41051c1031e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-ffc2788c-8adc-4613-ab2e-c38ed1088cb6-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-903c8e22-2655-426b-ac9c-043202641c71" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9380af38-4d72-4c71-b077-bcc3d536d059]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:35 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71 Aug 28 20:21:35 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:35 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71" returned: 0 in 0.386s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:35 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71 Aug 28 20:21:35 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Creating offline snapshot c388ae31-a52e-412c-9f52-c62cedba1c20 of volume a2ccd19c-752a-44c6-9d3b-860aed5aa6db {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c82c4e-c1f6-46a1-9181-9faca4ba7acf]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:36 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-903c8e22-2655-426b-ac9c-043202641c71" returned: 0 in 0.295s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-903c8e22-2655-426b-ac9c-043202641c71" released by "delete_volume" :: held 0.724s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created reservations ['9722052b-c12e-4964-9b28-151da1360977', '787b8408-4155-4ea0-bf15-6a557301e84f', '6a470236-f9f9-4b15-9beb-fea5a6ec2826', '7480d0fd-1f96-4f4f-bfb0-4425f4f99a0d'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:36 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db Aug 28 20:21:36 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:36 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:36 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Flow 'volume_create_manager' (b36818f4-2b14-490f-9d5b-bdcda97382d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de9be66-148d-450f-9ea7-5dafaeb874e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:36 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-0f8a49a5-c25f-4a07-b316-64d863af5ff9-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" returned: 0 in 0.461s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:36 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.303s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-0f8a49a5-c25f-4a07-b316-64d863af5ff9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:36 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 1G Aug 28 20:21:36 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de9be66-148d-450f-9ea7-5dafaeb874e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-101606200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a10bcd-d921-40bd-9959-ec4691c62b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992915b3d60f42a9b727149267038745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:37Z,use_quota=True,user_id='a62655026837455e9bb59d205d2153dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796b55ad-4877-419b-8f94-395ee3b576f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796b55ad-4877-419b-8f94-395ee3b576f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbadd95a-215d-4c17-a987-445ccd6b7ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbadd95a-215d-4c17-a987-445ccd6b7ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a10bcd-d921-40bd-9959-ec4691c62b4a', 'volume_name': 'volume-85a10bcd-d921-40bd-9959-ec4691c62b4a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d0fdbc-9f5c-4aa4-9340-07e08464276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d0fdbc-9f5c-4aa4-9340-07e08464276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0378a2e7-11ea-4c44-828c-87f7ce2bb55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Volume 85a10bcd-d921-40bd-9959-ec4691c62b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a10bcd-d921-40bd-9959-ec4691c62b4a', 'volume_size': 1} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:36 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Deleted volume successfully. Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-50955e8a-2360-4826-8f9f-8420efeea42c tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-903c8e22-2655-426b-ac9c-043202641c71-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-quobyte-0f8a49a5-c25f-4a07-b316-64d863af5ff9" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-0f8a49a5-c25f-4a07-b316-64d863af5ff9" acquired by "delete_volume" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff41d2d-74dc-4d26-884b-2d39e6ec672c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:36 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9 Aug 28 20:21:36 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:37 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 1G" returned: 0 in 0.416s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:37 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 Aug 28 20:21:37 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:37 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9" returned: 0 in 0.377s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:37 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9 Aug 28 20:21:37 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:37 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20" returned: 0 in 0.305s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:37 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 is being set with open permissions: ugo+rw Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:37 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 Aug 28 20:21:37 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:37 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f8a49a5-c25f-4a07-b316-64d863af5ff9" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-0f8a49a5-c25f-4a07-b316-64d863af5ff9" released by "delete_volume" :: held 0.658s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created reservations ['c5a927ea-60b4-45ce-b2fc-6d375e638de1', '912ac76c-058f-4051-aae0-5c1cf4c5ef33', '281211ec-4431-46ba-84d7-bcd569cefaa4', '972f84bc-e927-42d7-8c50-0540e72a6cec'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:37 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:37 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:37 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20" returned: 0 in 0.253s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:37 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.info Aug 28 20:21:37 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-662c4dab-cc74-4231-a7ea-1392fdfc37d2-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-662c4dab-cc74-4231-a7ea-1392fdfc37d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:37 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.257s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:37 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Deleted volume successfully. Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-493dcf73-8267-4987-b045-94aa70cea85d tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-0f8a49a5-c25f-4a07-b316-64d863af5ff9-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-quobyte-662c4dab-cc74-4231-a7ea-1392fdfc37d2" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-662c4dab-cc74-4231-a7ea-1392fdfc37d2" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a57263a-6419-4152-abdd-6f19beb8fe5b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:37 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.info" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:37 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.info is being set with open permissions: ugo+rw Aug 28 20:21:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:37 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.info Aug 28 20:21:37 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:37 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2 Aug 28 20:21:38 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:38 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.info" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-101606200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a10bcd-d921-40bd-9959-ec4691c62b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992915b3d60f42a9b727149267038745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:37Z,use_quota=True,user_id='a62655026837455e9bb59d205d2153dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Creating volume 85a10bcd-d921-40bd-9959-ec4691c62b4a {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:38 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:38 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a 1073741824 Aug 28 20:21:38 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:38 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2" returned: 0 in 0.381s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-63e6512b-1b7c-4411-97fc-b23af30d16b7 tempest-VolumesDeleteCascade-786693839 None] Create snapshot completed successfully Aug 28 20:21:38 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2 Aug 28 20:21:38 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:38 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-662c4dab-cc74-4231-a7ea-1392fdfc37d2" returned: 0 in 0.283s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-662c4dab-cc74-4231-a7ea-1392fdfc37d2" released by "delete_volume" :: held 0.711s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created reservations ['e8fd8b95-616a-482d-bf40-d534c14d96f2', 'e768799f-8568-4cc3-884c-26f16756a1f7', '03d4f7f1-b3c7-438d-a120-1bb2e1672cde', 'daf31f8f-f087-4ccd-b2dd-d3b763f89d1e'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:38 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a 1073741824" returned: 0 in 0.448s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:38 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:38 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:38 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a Aug 28 20:21:38 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:38 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.256s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Deleted volume successfully. Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-15e509b6-1b17-48b6-aa48-a70e48be0b7e tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-662c4dab-cc74-4231-a7ea-1392fdfc37d2-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:39 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-quobyte-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a" returned: 0 in 0.288s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0378a2e7-11ea-4c44-828c-87f7ce2bb55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a10bcd-d921-40bd-9959-ec4691c62b4a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ffac81-dacf-4b66-9667-74fcd8243da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6" acquired by "delete_volume" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:39 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Volume volume-85a10bcd-d921-40bd-9959-ec4691c62b4a (85a10bcd-d921-40bd-9959-ec4691c62b4a): created successfully Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ffac81-dacf-4b66-9667-74fcd8243da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Flow 'volume_create_manager' (b36818f4-2b14-490f-9d5b-bdcda97382d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b64353-31a7-405c-89e2-59c2a7f47277]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-452b57d3-48a8-4f7a-aa2a-2c328ea962aa tempest-AttachVolumeNegativeTest-868475344 None] Created volume successfully. Aug 28 20:21:39 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 Aug 28 20:21:39 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] Creating offline snapshot 32caf3de-adb7-465c-a1eb-a2ad0c5115f1 of volume a2ccd19c-752a-44c6-9d3b-860aed5aa6db {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:21:39 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6" returned: 0 in 0.377s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[449a98f0-3627-4af6-bcf0-ede2a8fbc666]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:39 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6 Aug 28 20:21:39 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:39 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 Aug 28 20:21:39 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:39 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6" released by "delete_volume" :: held 0.692s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created reservations ['d2790716-dd39-49fd-9290-a3367ed7cba2', 'ba45d6de-a4ed-400d-ab75-cd1f3b825ce5', '881ac73a-f70e-483d-a5cd-ee4dfa24cc2d', '2802e99a-70df-467b-88be-bd15608ef258'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:39 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20" returned: 0 in 0.411s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:21:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:39 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:39 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:39 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 1G Aug 28 20:21:39 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-ceab9956-e1fe-48c5-ad03-9e7b20bd5968-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:40 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.326s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Deleted volume successfully. Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-ceab9956-e1fe-48c5-ad03-9e7b20bd5968-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8a6671d6-a98c-4351-816f-87ddff2bf1ac tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-0f44f7c4-ddad-4b18-9357-c4a7df7f74f6-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "cinder-quobyte-ceab9956-e1fe-48c5-ad03-9e7b20bd5968" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-ceab9956-e1fe-48c5-ad03-9e7b20bd5968" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35e5360-4b11-44ed-a6d7-69a154589ac6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:40 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968 Aug 28 20:21:40 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:40 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 1G" returned: 0 in 0.621s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:40 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 Aug 28 20:21:40 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-b54cc8b5-7cd8-44e2-b6fb-36d9d4f4cd87 req-707e1896-40b6-488a-ad99-9012e9508a22 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:40 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968" returned: 0 in 0.368s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:40 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968 Aug 28 20:21:40 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:40 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1" returned: 0 in 0.302s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:40 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 is being set with open permissions: ugo+rw Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:40 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 Aug 28 20:21:40 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:40 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ceab9956-e1fe-48c5-ad03-9e7b20bd5968" returned: 0 in 0.244s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-quobyte-ceab9956-e1fe-48c5-ad03-9e7b20bd5968" released by "delete_volume" :: held 0.659s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Created reservations ['22274e47-eaa2-49f3-989e-2e428e333c4b', 'd72b59cc-0a7f-4a95-b268-f2439b905c58', '21fecb2e-d234-4dcb-a86f-a03f4114438b', 'cc6c9ba6-a2e9-4ecb-8233-1fce666577b4'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:41 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1" returned: 0 in 0.273s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:41 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:41 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.714s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-b54cc8b5-7cd8-44e2-b6fb-36d9d4f4cd87 req-707e1896-40b6-488a-ad99-9012e9508a22 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.559s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-b54cc8b5-7cd8-44e2-b6fb-36d9d4f4cd87 req-707e1896-40b6-488a-ad99-9012e9508a22 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9dfffc4c-e583-4dd6-9447-20ee32455cce tempest-VolumesDeleteCascade-786693839 None] Create snapshot completed successfully Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-b54cc8b5-7cd8-44e2-b6fb-36d9d4f4cd87 req-707e1896-40b6-488a-ad99-9012e9508a22 tempest-AttachVolumeNegativeTest-868475344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-85a10bcd-d921-40bd-9959-ec4691c62b4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14a6efc9-b3de-4a0b-8829-035b04d681f4', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:21:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-b54cc8b5-7cd8-44e2-b6fb-36d9d4f4cd87 req-707e1896-40b6-488a-ad99-9012e9508a22 tempest-AttachVolumeNegativeTest-868475344 None] attachment_update completed successfully. Aug 28 20:21:41 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.268s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Deleted volume successfully. Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-18d842c3-1da9-46c0-b574-ba6799300b93 tempest-CreateVolumesFromSourceVolumeTest-1289203839 None] Lock "cinder-ceab9956-e1fe-48c5-ad03-9e7b20bd5968-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-a2ccd19c-752a-44c6-9d3b-860aed5aa6db-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-a2ccd19c-752a-44c6-9d3b-860aed5aa6db-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Performing cascade delete. {{(pid=86028) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-32caf3de-adb7-465c-a1eb-a2ad0c5115f1-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-32caf3de-adb7-465c-a1eb-a2ad0c5115f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-32caf3de-adb7-465c-a1eb-a2ad0c5115f1" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-32caf3de-adb7-465c-a1eb-a2ad0c5115f1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Deleting offline snapshot 32caf3de-adb7-465c-a1eb-a2ad0c5115f1 of volume a2ccd19c-752a-44c6-9d3b-860aed5aa6db {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] snapshot_file for this snap is: volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36281ce-1846-4850-af0c-21d4bece19b1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:42 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 Aug 28 20:21:42 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:42 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1" returned: 0 in 0.374s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:21:42 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f35c408-2f09-4673-8493-c10355ee6820]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:42 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 Aug 28 20:21:42 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:42 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20" returned: 0 in 0.410s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:21:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:42 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 Aug 28 20:21:42 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:43 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1" returned: 0 in 0.498s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:43 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1 Aug 28 20:21:43 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:43 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-fee4ca96-0bdc-492d-83f5-0e47540954c7 req-39e90fda-17ac-4719-8b12-d5cae9a0b39b tempest-AttachVolumeNegativeTest-868475344 None] Terminate volume connection completed successfully. Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fee4ca96-0bdc-492d-83f5-0e47540954c7 req-39e90fda-17ac-4719-8b12-d5cae9a0b39b tempest-AttachVolumeNegativeTest-868475344 None] Deleting attachment 14a6efc9-b3de-4a0b-8829-035b04d681f4. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:21:43 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.32caf3de-adb7-465c-a1eb-a2ad0c5115f1" returned: 0 in 0.307s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-32caf3de-adb7-465c-a1eb-a2ad0c5115f1" released by "_delete_snapshot" :: held 1.701s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" released by "delete_snapshot" :: held 1.733s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Created reservations ['50baf105-ece6-4dbe-a65a-22300d504af9', 'cf8e3793-eb52-4738-a7ec-3b40c7047b22', '83c5bba8-f3bf-4a18-b81a-10e0713dfa6f', '91b56b1f-dd5e-43cc-b442-7a01d2a317be'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:43 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Delete snapshot completed successfully. Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-32caf3de-adb7-465c-a1eb-a2ad0c5115f1-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-c388ae31-a52e-412c-9f52-c62cedba1c20-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-c388ae31-a52e-412c-9f52-c62cedba1c20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-c388ae31-a52e-412c-9f52-c62cedba1c20" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-c388ae31-a52e-412c-9f52-c62cedba1c20" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Deleting offline snapshot c388ae31-a52e-412c-9f52-c62cedba1c20 of volume a2ccd19c-752a-44c6-9d3b-860aed5aa6db {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] snapshot_file for this snap is: volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7afd6a-a569-428c-8dcd-2141e0235da2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:43 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 Aug 28 20:21:43 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:44 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20" returned: 0 in 0.384s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:21:44 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[157159fc-2f4e-44a0-b6df-d282735a5071]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:44 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db Aug 28 20:21:44 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:44 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" returned: 0 in 0.455s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:44 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 Aug 28 20:21:44 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:45 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20" returned: 0 in 0.509s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:45 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20 Aug 28 20:21:45 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:45 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db.c388ae31-a52e-412c-9f52-c62cedba1c20" returned: 0 in 0.310s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-c388ae31-a52e-412c-9f52-c62cedba1c20" released by "_delete_snapshot" :: held 1.760s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" released by "delete_snapshot" :: held 1.783s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Created reservations ['fa81f5ee-fc69-4be5-b122-baf1446e0a4f', 'e0bf9aee-f957-4de1-84b0-f8432c7aafd5', '3efd3464-140e-4059-9d9d-fb94201b7ae6', '19019073-3d3d-42e9-9e22-39224e35f3a7'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Delete snapshot completed successfully. Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-c388ae31-a52e-412c-9f52-c62cedba1c20-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Snapshots deleted, issuing volume delete {{(pid=86028) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edd99ae-8706-4fb8-9356-cbdc2fc8d205]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Flow 'volume_create_manager' (d27f82ae-c033-478f-a948-e49a549401cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977f2ca4-ec29-4d32-865a-d7b8ad7000c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:46 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db Aug 28 20:21:46 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977f2ca4-ec29-4d32-865a-d7b8ad7000c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-799574450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e007047-a9a2-48e4-85cc-4fdd4885990a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9d8db321444b2a858744ea2542182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:46Z,use_quota=True,user_id='d06d8b035b2749719811aa1632cdb0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabeccd9-d426-4adb-b165-6795af18c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabeccd9-d426-4adb-b165-6795af18c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e533dd5c-6f07-4eb9-9ebf-5c5fa85a54b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e533dd5c-6f07-4eb9-9ebf-5c5fa85a54b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e007047-a9a2-48e4-85cc-4fdd4885990a', 'volume_name': 'volume-5e007047-a9a2-48e4-85cc-4fdd4885990a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22bea61-53a6-4598-b665-4b9b4a2f0432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22bea61-53a6-4598-b665-4b9b4a2f0432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5445c1-7855-4f93-8068-595b251a2203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:46 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Volume 5e007047-a9a2-48e4-85cc-4fdd4885990a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e007047-a9a2-48e4-85cc-4fdd4885990a', 'volume_size': 1} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-799574450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e007047-a9a2-48e4-85cc-4fdd4885990a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9d8db321444b2a858744ea2542182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:46Z,use_quota=True,user_id='d06d8b035b2749719811aa1632cdb0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Creating volume 5e007047-a9a2-48e4-85cc-4fdd4885990a {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:46 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:46 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a 1073741824 Aug 28 20:21:46 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:46 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" returned: 0 in 0.459s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:46 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db Aug 28 20:21:46 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:46 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" returned: 0 in 0.306s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:46 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a 1073741824" returned: 0 in 0.542s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-a2ccd19c-752a-44c6-9d3b-860aed5aa6db" released by "delete_volume" :: held 0.854s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:46 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a Aug 28 20:21:46 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Created reservations ['273d5200-9d33-4779-b423-b064552720f4', '93668e6c-e327-4e29-99f5-577ebaefa1f7', 'ec343908-a488-4517-8bd7-3c42a11998fc', '35a23032-c259-4eff-b7c8-daa03a3987e5'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:46 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:46 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:46 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a" returned: 0 in 0.284s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5445c1-7855-4f93-8068-595b251a2203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e007047-a9a2-48e4-85cc-4fdd4885990a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c27ceee-ede7-4378-9748-73c708ee5d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:47 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Volume volume-5e007047-a9a2-48e4-85cc-4fdd4885990a (5e007047-a9a2-48e4-85cc-4fdd4885990a): created successfully Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c27ceee-ede7-4378-9748-73c708ee5d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Flow 'volume_create_manager' (d27f82ae-c033-478f-a948-e49a549401cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:47 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d5f8e9c1-acfb-493f-bb7f-3456cd1c9ea4 tempest-ProjectReaderTests-516114998 None] Created volume successfully. Aug 28 20:21:47 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.286s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:47 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Deleted volume successfully. Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-312ee182-478e-4bd4-9a73-4946d56098e5 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-a2ccd19c-752a-44c6-9d3b-860aed5aa6db-delete_volume" released by "delete_volume" :: held 5.431s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Flow 'volume_create_manager' (cf592d93-efb2-493f-9ed0-e30f854fceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3474d87f-ac46-43ad-a511-c4699d448d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3474d87f-ac46-43ad-a511-c4699d448d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-582078140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f596c1-97b0-4164-a366-48788369db84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2235fa9eb60240888ad71cb068923193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:48Z,use_quota=True,user_id='ade13e431dc841b6b3f8376569ea1fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926ca1f1-71e5-4c8e-82c1-f493e57bf5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926ca1f1-71e5-4c8e-82c1-f493e57bf5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbe64cb-60cf-4a2e-b249-9a53a7c66521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbe64cb-60cf-4a2e-b249-9a53a7c66521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f596c1-97b0-4164-a366-48788369db84', 'volume_name': 'volume-19f596c1-97b0-4164-a366-48788369db84', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1203f562-77a1-4e92-ba60-00455d288e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1203f562-77a1-4e92-ba60-00455d288e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83aa74d6-1577-4c27-a034-94faf62c5f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:47 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Volume 19f596c1-97b0-4164-a366-48788369db84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f596c1-97b0-4164-a366-48788369db84', 'volume_size': 1} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-582078140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f596c1-97b0-4164-a366-48788369db84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2235fa9eb60240888ad71cb068923193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:48Z,use_quota=True,user_id='ade13e431dc841b6b3f8376569ea1fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Creating volume 19f596c1-97b0-4164-a366-48788369db84 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:47 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:47 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 1073741824 Aug 28 20:21:47 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Acquiring lock "cinder-5e007047-a9a2-48e4-85cc-4fdd4885990a-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Lock "cinder-5e007047-a9a2-48e4-85cc-4fdd4885990a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Acquiring lock "cinder-quobyte-5e007047-a9a2-48e4-85cc-4fdd4885990a" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Lock "cinder-quobyte-5e007047-a9a2-48e4-85cc-4fdd4885990a" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47def65-b0ef-41b6-83a0-6faaa4ce0a5f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:48 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 1073741824" returned: 0 in 0.493s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:48 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a Aug 28 20:21:48 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:48 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 Aug 28 20:21:48 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:48 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84" returned: 0 in 0.288s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:48 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a" returned: 0 in 0.386s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:48 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a Aug 28 20:21:48 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83aa74d6-1577-4c27-a034-94faf62c5f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f596c1-97b0-4164-a366-48788369db84', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9840ed6-1f73-49ba-8399-501283fb83b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:48 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Volume volume-19f596c1-97b0-4164-a366-48788369db84 (19f596c1-97b0-4164-a366-48788369db84): created successfully Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9840ed6-1f73-49ba-8399-501283fb83b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Flow 'volume_create_manager' (cf592d93-efb2-493f-9ed0-e30f854fceb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0a4bca47-30e5-4e53-90ac-ff7a5ce1f4a8 tempest-VolumesDeleteCascade-786693839 None] Created volume successfully. Aug 28 20:21:48 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5e007047-a9a2-48e4-85cc-4fdd4885990a" returned: 0 in 0.258s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Lock "cinder-quobyte-5e007047-a9a2-48e4-85cc-4fdd4885990a" released by "delete_volume" :: held 0.685s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Created reservations ['bdb71642-9810-4387-bd3d-ee93e3f880c7', 'bf812ff0-be9f-4f12-b229-f1342f900c36', 'cc4bad01-92aa-4e36-a0c4-979ef7953207', '59606b4d-88cd-40ee-a210-5565ec34e961'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:49 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:49 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "cinder-85a10bcd-d921-40bd-9959-ec4691c62b4a-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-85a10bcd-d921-40bd-9959-ec4691c62b4a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "cinder-quobyte-85a10bcd-d921-40bd-9959-ec4691c62b4a" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-quobyte-85a10bcd-d921-40bd-9959-ec4691c62b4a" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb8711-e44d-4d55-9d80-e3da69ac994c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:49 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.262s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Deleted volume successfully. Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-24acfe75-d49b-44e3-a5e9-7410622082ee tempest-ProjectReaderTests-516114998 None] Lock "cinder-5e007047-a9a2-48e4-85cc-4fdd4885990a-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:49 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a Aug 28 20:21:49 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:49 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a" returned: 0 in 0.402s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:49 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a Aug 28 20:21:49 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Flow 'volume_create_manager' (16e45efe-bf36-459a-bbdb-6257640f158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3d57d8-20cc-4830-8389-13096d3f70f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3d57d8-20cc-4830-8389-13096d3f70f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862317272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe112bb-551a-46bf-9cae-98d712918ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9d8db321444b2a858744ea2542182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:50Z,use_quota=True,user_id='d06d8b035b2749719811aa1632cdb0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e90c779-bef2-4be4-9516-8007f34a1b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e90c779-bef2-4be4-9516-8007f34a1b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce573d63-c72c-452d-bdfa-0c5ebd21525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce573d63-c72c-452d-bdfa-0c5ebd21525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe112bb-551a-46bf-9cae-98d712918ddb', 'volume_name': 'volume-dfe112bb-551a-46bf-9cae-98d712918ddb', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f693e53-1cdb-4d42-9dc1-a72991eb0a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f693e53-1cdb-4d42-9dc1-a72991eb0a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbd2bcb-7040-4a89-838c-634efec60330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:49 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Volume dfe112bb-551a-46bf-9cae-98d712918ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe112bb-551a-46bf-9cae-98d712918ddb', 'volume_size': 1} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1862317272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe112bb-551a-46bf-9cae-98d712918ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9d8db321444b2a858744ea2542182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:50Z,use_quota=True,user_id='d06d8b035b2749719811aa1632cdb0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Creating volume dfe112bb-551a-46bf-9cae-98d712918ddb {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:49 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:49 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-85a10bcd-d921-40bd-9959-ec4691c62b4a" returned: 0 in 0.273s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-quobyte-85a10bcd-d921-40bd-9959-ec4691c62b4a" released by "delete_volume" :: held 0.721s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:49 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb 1073741824 Aug 28 20:21:50 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Created reservations ['66c59669-ef34-4e02-aa3b-14ef69c33d77', '0f336032-6ccd-4599-950d-e5e18db41a84', 'a4fccc2a-d14b-43d5-9cbe-8d58bf61f9c4', '141de702-9159-453b-8364-b49503b986c9'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:50 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:50 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:50 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.254s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Deleted volume successfully. Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-356849f5-e799-4798-aa3e-7b6672ead659 tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-85a10bcd-d921-40bd-9959-ec4691c62b4a-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:50 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb 1073741824" returned: 0 in 0.492s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "cinder-e6f4642d-25e4-4293-a79a-c18501ee528c-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:50 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb Aug 28 20:21:50 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-e6f4642d-25e4-4293-a79a-c18501ee528c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "cinder-quobyte-e6f4642d-25e4-4293-a79a-c18501ee528c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-quobyte-e6f4642d-25e4-4293-a79a-c18501ee528c" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff895a5f-6cb7-4f78-b6e8-ab176a4780fe]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:50 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c Aug 28 20:21:50 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:50 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb" returned: 0 in 0.290s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.694s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbd2bcb-7040-4a89-838c-634efec60330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe112bb-551a-46bf-9cae-98d712918ddb', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10df7b0a-de7b-45b8-ab0f-97fe7e56c42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Creating offline snapshot 00d66ccd-c88c-410d-80c9-a5563837f6cb of volume 19f596c1-97b0-4164-a366-48788369db84 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:21:50 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Volume volume-dfe112bb-551a-46bf-9cae-98d712918ddb (dfe112bb-551a-46bf-9cae-98d712918ddb): created successfully Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10df7b0a-de7b-45b8-ab0f-97fe7e56c42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Flow 'volume_create_manager' (16e45efe-bf36-459a-bbdb-6257640f158c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef4ad19-eea9-45c2-abd5-46ddad981092]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e2ad5a49-cd43-426d-93b5-9aa0c588006e tempest-ProjectReaderTests-516114998 None] Created volume successfully. Aug 28 20:21:50 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 Aug 28 20:21:50 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:50 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c" returned: 0 in 0.369s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:51 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c Aug 28 20:21:51 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:51 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84" returned: 0 in 0.374s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:51 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e6f4642d-25e4-4293-a79a-c18501ee528c" returned: 0 in 0.260s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:51 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb 1G Aug 28 20:21:51 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-quobyte-e6f4642d-25e4-4293-a79a-c18501ee528c" released by "delete_volume" :: held 0.674s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Created reservations ['cd321b6f-ebf5-4bab-96eb-b86ba6aef352', 'cafd732a-7799-4869-9839-0cfaab3d313b', '8fcef03f-f435-40b2-89f3-a7fc5ea9e76c', 'e0437ede-9221-47f7-a961-4d7620fde6b4'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:51 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:51 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:51 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb 1G" returned: 0 in 0.397s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f596c1-97b0-4164-a366-48788369db84 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:51 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.273s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:51 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f596c1-97b0-4164-a366-48788369db84 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb Aug 28 20:21:51 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:51 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Deleted volume successfully. Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4335c392-365f-4944-ab79-c4166020e1de tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-e6f4642d-25e4-4293-a79a-c18501ee528c-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "cinder-f61fc862-1337-49ae-81ec-1bfbd6ab14f6-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-f61fc862-1337-49ae-81ec-1bfbd6ab14f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "cinder-quobyte-f61fc862-1337-49ae-81ec-1bfbd6ab14f6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-quobyte-f61fc862-1337-49ae-81ec-1bfbd6ab14f6" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae025db-4de2-497c-9250-91d1cc2fb3eb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:51 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Acquiring lock "cinder-dfe112bb-551a-46bf-9cae-98d712918ddb-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f596c1-97b0-4164-a366-48788369db84 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb" returned: 0 in 0.396s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:52 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb is being set with open permissions: ugo+rw Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Lock "cinder-dfe112bb-551a-46bf-9cae-98d712918ddb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:52 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb Aug 28 20:21:52 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Acquiring lock "cinder-quobyte-dfe112bb-551a-46bf-9cae-98d712918ddb" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Lock "cinder-quobyte-dfe112bb-551a-46bf-9cae-98d712918ddb" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab1814d-513f-4e5f-a43f-54cc6516e36a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:52 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6 Aug 28 20:21:52 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:52 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb Aug 28 20:21:52 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:52 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb" returned: 0 in 0.314s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:52 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6" returned: 0 in 0.425s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:52 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.info Aug 28 20:21:52 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:52 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6 Aug 28 20:21:52 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:52 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb" returned: 0 in 0.391s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:52 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb Aug 28 20:21:52 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:52 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:52 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f61fc862-1337-49ae-81ec-1bfbd6ab14f6" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.info" returned: 0 in 0.273s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:52 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.info is being set with open permissions: ugo+rw Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-quobyte-f61fc862-1337-49ae-81ec-1bfbd6ab14f6" released by "delete_volume" :: held 0.729s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:52 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.info Aug 28 20:21:52 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Created reservations ['0060d005-e838-47e9-bdeb-1060c1b1d3d2', '38af50d0-1f7c-417e-9b4f-b0e16e44181e', 'bd8f9d33-e5d4-4501-b18d-13b30c09b6a5', 'b267b418-89c3-4777-8b96-db68675d5102'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:52 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dfe112bb-551a-46bf-9cae-98d712918ddb" returned: 0 in 0.271s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Lock "cinder-quobyte-dfe112bb-551a-46bf-9cae-98d712918ddb" released by "delete_volume" :: held 0.722s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:52 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:52 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Created reservations ['aa306e77-b962-43d9-a017-50ad2f50fc3c', 'a50f426f-8122-4687-8f52-442a24086788', '662df1c5-e5ab-4e09-a252-c6545c3f1d37', '52c2f118-73bb-44cc-89a8-3a0a5cf711ac'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:52 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.info" returned: 0 in 0.249s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-eda9c056-30f6-4c58-b63a-37a39d4ecce3 tempest-VolumesDeleteCascade-786693839 None] Create snapshot completed successfully Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:53 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:53 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:53 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.269s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Deleted volume successfully. Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e5757372-0f88-4a1d-ac01-da5e04671d11 tempest-AttachVolumeNegativeTest-868475344 None] Lock "cinder-f61fc862-1337-49ae-81ec-1bfbd6ab14f6-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:53 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.277s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Deleted volume successfully. Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-234243e7-d3bc-469a-a92a-7fa26dd77a4c tempest-ProjectReaderTests-516114998 None] Lock "cinder-dfe112bb-551a-46bf-9cae-98d712918ddb-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Flow 'volume_create_manager' (eadcc063-1269-481b-827f-658c67d044a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5634bafa-8b6a-435e-82fc-eb32572d0b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5634bafa-8b6a-435e-82fc-eb32572d0b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914871718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09dd4a79-e2f5-4016-9813-9649844fbf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9d8db321444b2a858744ea2542182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:54Z,use_quota=True,user_id='d06d8b035b2749719811aa1632cdb0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c478b2e8-aba8-4a85-ad32-cc08b3ac26aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c478b2e8-aba8-4a85-ad32-cc08b3ac26aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6d13a9-37a0-41eb-b987-1da5bd7dc566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c6d13a9-37a0-41eb-b987-1da5bd7dc566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09dd4a79-e2f5-4016-9813-9649844fbf73', 'volume_name': 'volume-09dd4a79-e2f5-4016-9813-9649844fbf73', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb638cb-a939-4adc-89b6-0a77b617cf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb638cb-a939-4adc-89b6-0a77b617cf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600bef47-ede9-4fdb-b1d8-0f3bccaec586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:53 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Volume 09dd4a79-e2f5-4016-9813-9649844fbf73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09dd4a79-e2f5-4016-9813-9649844fbf73', 'volume_size': 1} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914871718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09dd4a79-e2f5-4016-9813-9649844fbf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9d8db321444b2a858744ea2542182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:54Z,use_quota=True,user_id='d06d8b035b2749719811aa1632cdb0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Creating volume 09dd4a79-e2f5-4016-9813-9649844fbf73 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:54 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:54 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73 1073741824 Aug 28 20:21:54 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Flow 'volume_create_manager' (1cc39da5-6202-4ab5-8224-073b432be9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf6aba4-3359-483b-ab9c-90dc396eebbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf6aba4-3359-483b-ab9c-90dc396eebbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1464507965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3757cb5e-f064-4300-830a-e2aa9f8af864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2235fa9eb60240888ad71cb068923193',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=00d66ccd-c88c-410d-80c9-a5563837f6cb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:21:54Z,use_quota=True,user_id='ade13e431dc841b6b3f8376569ea1fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece23aac-b41c-4ec7-809e-903a08843e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece23aac-b41c-4ec7-809e-903a08843e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bb1278-df59-4ae2-90ae-4c4d17a4196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bb1278-df59-4ae2-90ae-4c4d17a4196b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3757cb5e-f064-4300-830a-e2aa9f8af864', 'volume_name': 'volume-3757cb5e-f064-4300-830a-e2aa9f8af864', 'volume_size': 1, 'snapshot_id': '00d66ccd-c88c-410d-80c9-a5563837f6cb'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2262b40-6bf9-4fd9-b2b1-b0a980c3c50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2262b40-6bf9-4fd9-b2b1-b0a980c3c50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c463fc-a6f4-44be-8fea-57a4e584c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:54 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Volume 3757cb5e-f064-4300-830a-e2aa9f8af864: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3757cb5e-f064-4300-830a-e2aa9f8af864', 'volume_size': 1, 'snapshot_id': '00d66ccd-c88c-410d-80c9-a5563837f6cb'} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:54 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73 1073741824" returned: 0 in 0.437s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:54 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73 Aug 28 20:21:54 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:54 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73" returned: 0 in 0.297s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.634s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-00d66ccd-c88c-410d-80c9-a5563837f6cb-3757cb5e-f064-4300-830a-e2aa9f8af864" by "_create_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600bef47-ede9-4fdb-b1d8-0f3bccaec586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09dd4a79-e2f5-4016-9813-9649844fbf73', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9f97c1-d6d6-412d-8feb-e9c1f92dd68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-00d66ccd-c88c-410d-80c9-a5563837f6cb-3757cb5e-f064-4300-830a-e2aa9f8af864" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Creating volume 3757cb5e-f064-4300-830a-e2aa9f8af864 from snapshot 00d66ccd-c88c-410d-80c9-a5563837f6cb {{(pid=86028) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-3757cb5e-f064-4300-830a-e2aa9f8af864" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:54 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Volume volume-09dd4a79-e2f5-4016-9813-9649844fbf73 (09dd4a79-e2f5-4016-9813-9649844fbf73): created successfully Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9f97c1-d6d6-412d-8feb-e9c1f92dd68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Flow 'volume_create_manager' (eadcc063-1269-481b-827f-658c67d044a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-3757cb5e-f064-4300-830a-e2aa9f8af864" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] snapshot: 00d66ccd-c88c-410d-80c9-a5563837f6cb, volume: 3757cb5e-f064-4300-830a-e2aa9f8af864, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a4d12d17-0cd3-4fbc-a6d0-acceba6fcf2b tempest-ProjectReaderTests-516114998 None] Created volume successfully. Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae696cfc-9d5f-487c-8f5f-c44f092d1a37]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:55 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb Aug 28 20:21:55 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:55 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb" returned: 0 in 0.385s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f596c1-97b0-4164-a366-48788369db84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30472e2-a284-407e-8dd9-85185be7d2f0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:55 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 Aug 28 20:21:55 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:55 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84" returned: 0 in 0.377s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:55 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 Aug 28 20:21:55 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Acquiring lock "cinder-09dd4a79-e2f5-4016-9813-9649844fbf73-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Lock "cinder-09dd4a79-e2f5-4016-9813-9649844fbf73-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Acquiring lock "cinder-quobyte-09dd4a79-e2f5-4016-9813-9649844fbf73" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Lock "cinder-quobyte-09dd4a79-e2f5-4016-9813-9649844fbf73" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[de532b22-5aa9-4302-b836-63702c294560]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:21:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:56 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73 Aug 28 20:21:56 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:56 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73" returned: 0 in 0.884s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:56 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73 Aug 28 20:21:56 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:57 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-09dd4a79-e2f5-4016-9813-9649844fbf73" returned: 0 in 0.680s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Lock "cinder-quobyte-09dd4a79-e2f5-4016-9813-9649844fbf73" released by "delete_volume" :: held 1.649s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:57 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Created reservations ['1cc464de-8f85-4452-9b40-831fb3e30468', '68f97977-b3f4-4555-a8fe-3f1c2fbec93b', 'c8f00a7e-cccf-4056-a51f-47289a1d6a74', '67b4ecdb-668f-46c0-ac6a-5aaae39408dc'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:21:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:21:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:21:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:21:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:21:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:21:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:21:58 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:21:58 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:21:58 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Aug 28 20:21:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 1.007s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:21:58 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:21:58 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Deleted volume successfully. Aug 28 20:21:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6723592-181c-4ded-9acc-2625c6f939a7 tempest-ProjectReaderTests-516114998 None] Lock "cinder-09dd4a79-e2f5-4016-9813-9649844fbf73-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:21:59 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:21:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Flow 'volume_create_manager' (844d1ba1-61bd-4912-9d0d-9c13aae2d868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:21:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566681cd-a967-43af-98d1-d630192b6249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566681cd-a967-43af-98d1-d630192b6249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305842156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368d406c-a90c-45ed-9b58-66e85b605fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9d8db321444b2a858744ea2542182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:00Z,use_quota=True,user_id='d06d8b035b2749719811aa1632cdb0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ca00ab-6c78-4709-ae2d-d50efcbad085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ca00ab-6c78-4709-ae2d-d50efcbad085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a761c30-6104-428e-ab9f-1de241d86d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a761c30-6104-428e-ab9f-1de241d86d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368d406c-a90c-45ed-9b58-66e85b605fe8', 'volume_name': 'volume-368d406c-a90c-45ed-9b58-66e85b605fe8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:21:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20466920-03e3-4653-9a78-1887517bfa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:21:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20466920-03e3-4653-9a78-1887517bfa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4bfdadc-443a-4ece-908b-983ac61f8158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:00 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Volume 368d406c-a90c-45ed-9b58-66e85b605fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368d406c-a90c-45ed-9b58-66e85b605fe8', 'volume_size': 1} Aug 28 20:22:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:01 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864" returned: 0 in 5.324s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:22:01 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Converted 1024.00 MB image at 192.32 MB/s Aug 28 20:22:01 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 is being set with open permissions: ugo+rw Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:01 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 Aug 28 20:22:01 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:01 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-3757cb5e-f064-4300-830a-e2aa9f8af864" released by "_copy_volume_from_snapshot" :: held 6.437s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-00d66ccd-c88c-410d-80c9-a5563837f6cb-3757cb5e-f064-4300-830a-e2aa9f8af864" released by "_create_volume_from_snapshot" :: held 6.510s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.540s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.318s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305842156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368d406c-a90c-45ed-9b58-66e85b605fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3b9d8db321444b2a858744ea2542182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:00Z,use_quota=True,user_id='d06d8b035b2749719811aa1632cdb0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Creating volume 368d406c-a90c-45ed-9b58-66e85b605fe8 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:01 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:01 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8 1073741824 Aug 28 20:22:01 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c463fc-a6f4-44be-8fea-57a4e584c03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3757cb5e-f064-4300-830a-e2aa9f8af864', 'volume_size': 1, 'snapshot_id': '00d66ccd-c88c-410d-80c9-a5563837f6cb'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b2bc90-932f-45b0-8ed7-8c4cba80fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:01 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Volume volume-3757cb5e-f064-4300-830a-e2aa9f8af864 (3757cb5e-f064-4300-830a-e2aa9f8af864): created successfully Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b2bc90-932f-45b0-8ed7-8c4cba80fddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Flow 'volume_create_manager' (1cc39da5-6202-4ab5-8224-073b432be9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:01 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0d3a39c2-48c0-4dcc-a9fb-735ce671e53f tempest-VolumesDeleteCascade-786693839 None] Created volume successfully. Aug 28 20:22:01 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8 1073741824" returned: 0 in 0.462s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:01 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8 Aug 28 20:22:01 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-19f596c1-97b0-4164-a366-48788369db84-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-19f596c1-97b0-4164-a366-48788369db84-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Performing cascade delete. {{(pid=86028) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-00d66ccd-c88c-410d-80c9-a5563837f6cb-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-00d66ccd-c88c-410d-80c9-a5563837f6cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-19f596c1-97b0-4164-a366-48788369db84" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-19f596c1-97b0-4164-a366-48788369db84" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-00d66ccd-c88c-410d-80c9-a5563837f6cb" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-00d66ccd-c88c-410d-80c9-a5563837f6cb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Deleting offline snapshot 00d66ccd-c88c-410d-80c9-a5563837f6cb of volume 19f596c1-97b0-4164-a366-48788369db84 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] snapshot_file for this snap is: volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[95df6bb0-02b3-4e61-9e79-eae57c122cda]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:02 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8" returned: 0 in 0.270s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4bfdadc-443a-4ece-908b-983ac61f8158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368d406c-a90c-45ed-9b58-66e85b605fe8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b95cbf-4144-48a9-8a60-8872b625da25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:02 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Volume volume-368d406c-a90c-45ed-9b58-66e85b605fe8 (368d406c-a90c-45ed-9b58-66e85b605fe8): created successfully Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b95cbf-4144-48a9-8a60-8872b625da25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Flow 'volume_create_manager' (844d1ba1-61bd-4912-9d0d-9c13aae2d868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c967b579-1344-4af4-a54f-a10e21a19134 tempest-ProjectReaderTests-516114998 None] Created volume successfully. Aug 28 20:22:02 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb Aug 28 20:22:02 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:02 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb" returned: 0 in 0.370s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f596c1-97b0-4164-a366-48788369db84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c65ed86-9c82-4415-bb4d-a01e3ba0fc30]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:02 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 Aug 28 20:22:02 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Acquiring lock "cinder-368d406c-a90c-45ed-9b58-66e85b605fe8-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Lock "cinder-368d406c-a90c-45ed-9b58-66e85b605fe8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Acquiring lock "cinder-quobyte-368d406c-a90c-45ed-9b58-66e85b605fe8" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Lock "cinder-quobyte-368d406c-a90c-45ed-9b58-66e85b605fe8" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a73b2c9-6b9c-42e9-8614-07d2a55881f8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:03 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84" returned: 0 in 0.595s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:03 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb Aug 28 20:22:03 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:03 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8 Aug 28 20:22:03 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:03 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8" returned: 0 in 0.423s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:03 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8 Aug 28 20:22:03 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:03 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb" returned: 0 in 0.404s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:03 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb Aug 28 20:22:03 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Flow 'volume_create_manager' (78434d9e-af41-424b-aca9-76ab22014528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f45bc0d-a2fd-451a-8e89-47158bbc3995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f45bc0d-a2fd-451a-8e89-47158bbc3995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2003174794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0406bb8-9ead-4475-bef1-d2791583f65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547598cbf71f4c19bca5dae3d63e26cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:04Z,use_quota=True,user_id='29fa6a1d6a594caaaab916200324b327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f8053d-ef75-492a-b20e-d28ed13484b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f8053d-ef75-492a-b20e-d28ed13484b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753a38d5-a0cf-41a2-9e8a-a13d9b8d677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753a38d5-a0cf-41a2-9e8a-a13d9b8d677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0406bb8-9ead-4475-bef1-d2791583f65c', 'volume_name': 'volume-e0406bb8-9ead-4475-bef1-d2791583f65c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc150b8-a20a-41af-b525-0f209b4aff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc150b8-a20a-41af-b525-0f209b4aff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7f3f5b-c5b5-4d5f-9492-5ab555767fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:03 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Volume e0406bb8-9ead-4475-bef1-d2791583f65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0406bb8-9ead-4475-bef1-d2791583f65c', 'volume_size': 1} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2003174794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0406bb8-9ead-4475-bef1-d2791583f65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547598cbf71f4c19bca5dae3d63e26cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:04Z,use_quota=True,user_id='29fa6a1d6a594caaaab916200324b327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Creating volume e0406bb8-9ead-4475-bef1-d2791583f65c {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:03 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:03 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-368d406c-a90c-45ed-9b58-66e85b605fe8" returned: 0 in 0.268s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:03 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c 1073741824 Aug 28 20:22:03 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Lock "cinder-quobyte-368d406c-a90c-45ed-9b58-66e85b605fe8" released by "delete_volume" :: held 0.734s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:03 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Created reservations ['2ee952b4-6188-4481-a665-6059c5f8eb3b', '004c1ade-0cb9-4193-8ccb-e468c1341fb6', 'e1f06c2c-13ee-406f-95ce-d1deff788054', '621adf8f-f7b0-49fe-a662-d4ab1271401b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84.00d66ccd-c88c-410d-80c9-a5563837f6cb" returned: 0 in 0.292s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-00d66ccd-c88c-410d-80c9-a5563837f6cb" released by "_delete_snapshot" :: held 1.756s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-19f596c1-97b0-4164-a366-48788369db84" released by "delete_snapshot" :: held 1.785s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:03 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Created reservations ['8da14f1b-4540-4a5c-b67f-742954defc9a', '64353d71-91e8-4453-88dd-ebea2f857068', '198a20ae-15f4-42b3-868b-b6f974509c37', 'adf7689c-10df-46b1-9b6d-dd9cdd6acf44'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:03 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:03 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Delete snapshot completed successfully. Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-00d66ccd-c88c-410d-80c9-a5563837f6cb-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Snapshots deleted, issuing volume delete {{(pid=86028) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-19f596c1-97b0-4164-a366-48788369db84" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-19f596c1-97b0-4164-a366-48788369db84" acquired by "delete_volume" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5990fe-f823-43e5-bc79-c928e31a6fd1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:04 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 Aug 28 20:22:04 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:04 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.319s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:04 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Deleted volume successfully. Aug 28 20:22:04 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4baa602c-afd7-4c0f-898d-25c722de9196 tempest-ProjectReaderTests-516114998 None] Lock "cinder-368d406c-a90c-45ed-9b58-66e85b605fe8-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c 1073741824" returned: 0 in 0.550s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:04 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c Aug 28 20:22:04 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:04 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84" returned: 0 in 0.409s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:04 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84 Aug 28 20:22:04 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:04 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c" returned: 0 in 0.259s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7f3f5b-c5b5-4d5f-9492-5ab555767fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0406bb8-9ead-4475-bef1-d2791583f65c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c1cdc3-0b29-4896-8713-ccf6271854b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:04 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Volume volume-e0406bb8-9ead-4475-bef1-d2791583f65c (e0406bb8-9ead-4475-bef1-d2791583f65c): created successfully Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c1cdc3-0b29-4896-8713-ccf6271854b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Flow 'volume_create_manager' (78434d9e-af41-424b-aca9-76ab22014528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:04 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-d58078ca-0c44-4445-b442-4c6037215d87 req-09da8c34-4eb4-4c83-9a27-9b0c6f3922ae tempest-VolumesSnapshotsTestJSON-554517256 None] Created volume successfully. Aug 28 20:22:04 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-19f596c1-97b0-4164-a366-48788369db84" returned: 0 in 0.320s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-19f596c1-97b0-4164-a366-48788369db84" released by "delete_volume" :: held 0.805s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Created reservations ['6132a88e-4c4b-41c6-a10f-eefec3c311b3', '3e04ed11-4fed-4a7f-97bf-f18210f388f0', '7c9ee521-33e2-45ea-ab40-19ce0fffedba', 'eec3b993-8f94-47ef-ac1b-12684b7c8411'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:04 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:04 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Creating offline snapshot 3047ac32-4dff-468f-a84b-683e774fae71 of volume e0406bb8-9ead-4475-bef1-d2791583f65c {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9af4d4-89f5-4caa-b948-f644af9c85a4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:05 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c Aug 28 20:22:05 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:05 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.359s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:05 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Deleted volume successfully. Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-e20ac2d2-db65-4a39-8fab-5c939755e178 tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-19f596c1-97b0-4164-a366-48788369db84-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-3757cb5e-f064-4300-830a-e2aa9f8af864-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-3757cb5e-f064-4300-830a-e2aa9f8af864-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "cinder-quobyte-3757cb5e-f064-4300-830a-e2aa9f8af864" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-3757cb5e-f064-4300-830a-e2aa9f8af864" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:05 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c" returned: 0 in 0.529s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1421aee1-45fe-4bca-a420-c60c2c71f0d7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:05 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 1G Aug 28 20:22:05 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:05 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 Aug 28 20:22:05 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:06 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864" returned: 0 in 0.414s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:06 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 1G" returned: 0 in 0.447s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0406bb8-9ead-4475-bef1-d2791583f65c -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:06 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864 Aug 28 20:22:06 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:06 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0406bb8-9ead-4475-bef1-d2791583f65c -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 Aug 28 20:22:06 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:06 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3757cb5e-f064-4300-830a-e2aa9f8af864" returned: 0 in 0.271s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-quobyte-3757cb5e-f064-4300-830a-e2aa9f8af864" released by "delete_volume" :: held 0.781s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:06 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0406bb8-9ead-4475-bef1-d2791583f65c -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71" returned: 0 in 0.311s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:06 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 is being set with open permissions: ugo+rw Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Created reservations ['24a26ea6-5a7e-4a91-a659-4545edf5cd5a', 'fe87ef20-5a72-4d95-8775-686885b62b0a', 'dc48197a-9560-4723-a504-f8291acfddae', 'db7b6c40-ea89-4d83-afe0-fb1f41664f8b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:06 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 Aug 28 20:22:06 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:06 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:06 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:06 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71" returned: 0 in 0.278s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:06 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.info Aug 28 20:22:06 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:06 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.284s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:06 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Deleted volume successfully. Aug 28 20:22:06 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:06 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-507b1cf8-c450-4c60-a8eb-5275c1c774ac tempest-VolumesDeleteCascade-786693839 None] Lock "cinder-3757cb5e-f064-4300-830a-e2aa9f8af864-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:06 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.info" returned: 0 in 0.303s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:06 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.info is being set with open permissions: ugo+rw Aug 28 20:22:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:06 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.info Aug 28 20:22:06 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:07 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.287s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:22:07 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.info" returned: 0 in 0.266s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:07 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-04025e0e-17b9-4227-94d2-a71da80e8047 req-9d863126-1510-489d-b1f8-ce1111d06bd4 tempest-VolumesSnapshotsTestJSON-554517256 None] Create snapshot completed successfully Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Acquiring lock "cinder-3047ac32-4dff-468f-a84b-683e774fae71-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "cinder-3047ac32-4dff-468f-a84b-683e774fae71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Acquiring lock "cinder-quobyte-e0406bb8-9ead-4475-bef1-d2791583f65c" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "cinder-quobyte-e0406bb8-9ead-4475-bef1-d2791583f65c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Acquiring lock "cinder-quobyte-3047ac32-4dff-468f-a84b-683e774fae71" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "cinder-quobyte-3047ac32-4dff-468f-a84b-683e774fae71" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Deleting offline snapshot 3047ac32-4dff-468f-a84b-683e774fae71 of volume e0406bb8-9ead-4475-bef1-d2791583f65c {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] snapshot_file for this snap is: volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[34926637-4635-40b7-8a26-c3d123df15e1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:07 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 Aug 28 20:22:07 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:08 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71" returned: 0 in 0.379s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0406bb8-9ead-4475-bef1-d2791583f65c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:22:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f45c2e-980c-48d0-b970-737fa03f8fb3]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:08 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c Aug 28 20:22:08 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:08 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c" returned: 0 in 0.366s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:08 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 Aug 28 20:22:08 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:08 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71" returned: 0 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:08 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71 Aug 28 20:22:08 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:09 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c.3047ac32-4dff-468f-a84b-683e774fae71" returned: 0 in 0.264s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "cinder-quobyte-3047ac32-4dff-468f-a84b-683e774fae71" released by "_delete_snapshot" :: held 1.520s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "cinder-quobyte-e0406bb8-9ead-4475-bef1-d2791583f65c" released by "delete_snapshot" :: held 1.549s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:09 devstack cinder-volume[86028]: DEBUG cinder.quota [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Created reservations ['a5523f2a-547a-4ec9-9c95-c24689cd125d', 'ded62bd0-9b4b-46e3-94e0-b487822e9c38', 'af8b27aa-3be0-4a67-b93e-27ab7fe66f0a', 'af9ee186-4609-4b0c-8944-280f306debe6'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:09 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Delete snapshot completed successfully. Aug 28 20:22:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-2ce165ce-ee6c-46ed-a39c-440dc4742d91 req-caf790cb-a75f-4d50-a8a6-5136d905a474 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "cinder-3047ac32-4dff-468f-a84b-683e774fae71-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Acquiring lock "cinder-e0406bb8-9ead-4475-bef1-d2791583f65c-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "cinder-e0406bb8-9ead-4475-bef1-d2791583f65c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Acquiring lock "cinder-quobyte-e0406bb8-9ead-4475-bef1-d2791583f65c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "cinder-quobyte-e0406bb8-9ead-4475-bef1-d2791583f65c" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a9ccf4-8a20-4081-8dec-1aba4ee62e7e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:10 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c Aug 28 20:22:10 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:10 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c" returned: 0 in 0.372s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:10 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c Aug 28 20:22:10 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:10 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e0406bb8-9ead-4475-bef1-d2791583f65c" returned: 0 in 0.284s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "cinder-quobyte-e0406bb8-9ead-4475-bef1-d2791583f65c" released by "delete_volume" :: held 0.739s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.quota [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Created reservations ['6fb7f638-0ee7-433e-acf1-79a06bb0b9a8', '7b9073f4-acfd-40b0-b538-c8d4d7fb6785', '73e106f9-8c71-4a7f-8a14-973ace215b8f', '6c76c70f-dc4b-4e9c-9519-8acc6bd0018f'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:10 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:10 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Flow 'volume_create_manager' (b0fc4577-4422-450f-a235-7af438bcc81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd86ae10-cdab-4562-be11-5622f279121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd86ae10-cdab-4562-be11-5622f279121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-774025705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d33d98f-464f-4711-9ac6-ea95a310a61d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c9b3b7ce58c434da33bfadd889f7437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:11Z,use_quota=True,user_id='42841537ae774e92ba3c51373d973d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412f2426-064f-4806-a007-f23af7140b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412f2426-064f-4806-a007-f23af7140b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee76a01f-af9b-42dd-af1d-b7b717096ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee76a01f-af9b-42dd-af1d-b7b717096ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d33d98f-464f-4711-9ac6-ea95a310a61d', 'volume_name': 'volume-8d33d98f-464f-4711-9ac6-ea95a310a61d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77eb1e76-3461-4fb1-b3e0-c2cb22fe87e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77eb1e76-3461-4fb1-b3e0-c2cb22fe87e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ece369a-f77b-4d3e-9ba6-81f19849c573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:10 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Volume 8d33d98f-464f-4711-9ac6-ea95a310a61d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d33d98f-464f-4711-9ac6-ea95a310a61d', 'volume_size': 1} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-774025705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d33d98f-464f-4711-9ac6-ea95a310a61d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c9b3b7ce58c434da33bfadd889f7437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:11Z,use_quota=True,user_id='42841537ae774e92ba3c51373d973d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Creating volume 8d33d98f-464f-4711-9ac6-ea95a310a61d {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:10 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:11 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d 1073741824 Aug 28 20:22:11 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:11 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.265s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG cinder.manager [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:11 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Deleted volume successfully. Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-3bd0c8c2-4527-4bfe-9c67-af9805e108dd req-4e14cec1-b01c-4684-ab55-671f72090370 tempest-VolumesSnapshotsTestJSON-554517256 None] Lock "cinder-e0406bb8-9ead-4475-bef1-d2791583f65c-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:11 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d 1073741824" returned: 0 in 0.453s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:11 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d Aug 28 20:22:11 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:11 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ece369a-f77b-4d3e-9ba6-81f19849c573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d33d98f-464f-4711-9ac6-ea95a310a61d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a0a90b-8082-4a50-a8fa-54c51b2880eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:11 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Volume volume-8d33d98f-464f-4711-9ac6-ea95a310a61d (8d33d98f-464f-4711-9ac6-ea95a310a61d): created successfully Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a0a90b-8082-4a50-a8fa-54c51b2880eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Flow 'volume_create_manager' (b0fc4577-4422-450f-a235-7af438bcc81c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:11 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-57c1148d-f9f2-4e6f-bd4c-d7ad10829533 tempest-VolumesTransfersTest-1883908157 None] Created volume successfully. Aug 28 20:22:12 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d7db7bdd-8acd-41fc-a6a2-171f0c8ba0af tempest-VolumesTransfersTest-1623281131 None] Transfer volume completed successfully. Aug 28 20:22:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Acquiring lock "cinder-8d33d98f-464f-4711-9ac6-ea95a310a61d-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Lock "cinder-8d33d98f-464f-4711-9ac6-ea95a310a61d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Acquiring lock "cinder-quobyte-8d33d98f-464f-4711-9ac6-ea95a310a61d" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Lock "cinder-quobyte-8d33d98f-464f-4711-9ac6-ea95a310a61d" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:13 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f930bc81-61ab-48e5-bc9e-2265935f2e43]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:13 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d Aug 28 20:22:13 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:13 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d" returned: 0 in 0.376s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:13 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d Aug 28 20:22:13 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:13 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8d33d98f-464f-4711-9ac6-ea95a310a61d" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Lock "cinder-quobyte-8d33d98f-464f-4711-9ac6-ea95a310a61d" released by "delete_volume" :: held 0.672s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Created reservations ['b6c3e027-2a95-4585-9d25-2026b800a6b9', '1e612d27-f03a-4394-9894-70d94c0df072', '051d6e32-2e47-4610-808d-959e4103ea95', '75a1f90f-b2ec-4a7a-9a63-96a67322262b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:14 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:14 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:14 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.266s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:14 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Deleted volume successfully. Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-33f09a05-f1ac-401f-b231-e21f00ec62f0 tempest-VolumesTransfersTest-1401682821 None] Lock "cinder-8d33d98f-464f-4711-9ac6-ea95a310a61d-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Flow 'volume_create_manager' (188f7735-20b7-4124-9c43-d0050fb9ed36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c78d9f9-bdd8-4470-9469-a02684815a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c78d9f9-bdd8-4470-9469-a02684815a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-495094017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47f8f1a-23a0-4eb4-a2fb-0281b5552f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c9b3b7ce58c434da33bfadd889f7437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:15Z,use_quota=True,user_id='42841537ae774e92ba3c51373d973d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e766c8a3-21c8-48e7-805f-0979b9d001d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e766c8a3-21c8-48e7-805f-0979b9d001d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063c45d8-fadc-4456-a549-5062838cae12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063c45d8-fadc-4456-a549-5062838cae12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a47f8f1a-23a0-4eb4-a2fb-0281b5552f13', 'volume_name': 'volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a609517-4554-48d8-9b83-c8315d1afbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a609517-4554-48d8-9b83-c8315d1afbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ba29eb-7d60-43c9-ae24-2e4b08248076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:15 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Volume a47f8f1a-23a0-4eb4-a2fb-0281b5552f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13', 'volume_size': 1} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-495094017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47f8f1a-23a0-4eb4-a2fb-0281b5552f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c9b3b7ce58c434da33bfadd889f7437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:15Z,use_quota=True,user_id='42841537ae774e92ba3c51373d973d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Creating volume a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:15 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:15 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 1073741824 Aug 28 20:22:15 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:15 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3ff50142-c4b2-42a8-b74c-52d38f49f722 tempest-GroupsTest-1723362095 None] Group tempest-Group1-736417227: creating Aug 28 20:22:15 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3ff50142-c4b2-42a8-b74c-52d38f49f722 tempest-GroupsTest-1723362095 None] Group tempest-Group1-736417227: created successfully Aug 28 20:22:15 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3ff50142-c4b2-42a8-b74c-52d38f49f722 tempest-GroupsTest-1723362095 None] Create group completed successfully. Aug 28 20:22:15 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 1073741824" returned: 0 in 0.405s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:15 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 Aug 28 20:22:15 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:15 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13" returned: 0 in 0.271s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ba29eb-7d60-43c9-ae24-2e4b08248076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a331d4bf-9baa-4116-82ee-858646c14f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:15 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Volume volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 (a47f8f1a-23a0-4eb4-a2fb-0281b5552f13): created successfully Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a331d4bf-9baa-4116-82ee-858646c14f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Flow 'volume_create_manager' (188f7735-20b7-4124-9c43-d0050fb9ed36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:15 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-982975b4-3f55-48f3-b0b3-2bfa784c6b7e tempest-VolumesTransfersTest-1883908157 None] Created volume successfully. Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Acquiring lock "cinder-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Lock "cinder-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Acquiring lock "cinder-quobyte-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Lock "cinder-quobyte-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1abf41-979b-48f4-8e86-6c6d55d86f34]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:16 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 Aug 28 20:22:16 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-428c8fa4-ae5d-46b0-b316-9d829809c7d1 tempest-GroupsTest-1723362095 None] Group tempest-Group2-819509347: creating Aug 28 20:22:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-428c8fa4-ae5d-46b0-b316-9d829809c7d1 tempest-GroupsTest-1723362095 None] Group tempest-Group2-819509347: created successfully Aug 28 20:22:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-428c8fa4-ae5d-46b0-b316-9d829809c7d1 tempest-GroupsTest-1723362095 None] Create group completed successfully. Aug 28 20:22:16 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13" returned: 0 in 0.364s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:16 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13 Aug 28 20:22:16 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:16 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13" returned: 0 in 0.237s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Lock "cinder-quobyte-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13" released by "delete_volume" :: held 0.649s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Created reservations ['3cca64c7-db5b-4070-837d-c585f8a3eb5d', 'e5c5bf08-3b9f-4ba9-8128-902a3fc02dd7', '004022d0-e456-4906-848e-6f41ea50ead5', 'd838b0f8-bd89-43d9-8017-ee5f08be4a7c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:17 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:17 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:17 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:17 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:17 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Deleted volume successfully. Aug 28 20:22:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9c82d10-77f1-406c-a125-989b89b91e56 tempest-VolumesTransfersTest-1401682821 None] Lock "cinder-a47f8f1a-23a0-4eb4-a2fb-0281b5552f13-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Flow 'volume_create_manager' (130d0d62-e8fe-44f7-aba3-1459efdd803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6895b1c-5b50-49ed-8a79-58522438c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6895b1c-5b50-49ed-8a79-58522438c665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-830117021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7de3fa91-99c5-44ea-a796-d8f309dc68ba,host='devstack@QuobyteHD#QuobyteHD',id=2ded1838-ff71-493b-b0b9-c227fd348edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6224e2b86426469597ce2750ea0149e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:18Z,use_quota=True,user_id='e9298da1c8ba47dca28298949b30651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5f5dbfb-3ea2-4bfc-9467-dba31fbb30c7),volume_type_id=c5f5dbfb-3ea2-4bfc-9467-dba31fbb30c7)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6faf4e-712a-449b-8f5c-5fdcc2b0463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6faf4e-712a-449b-8f5c-5fdcc2b0463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e823d298-e778-48b0-85ba-5d790573f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e823d298-e778-48b0-85ba-5d790573f317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ded1838-ff71-493b-b0b9-c227fd348edb', 'volume_name': 'volume-2ded1838-ff71-493b-b0b9-c227fd348edb', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59533720-f9a7-499f-9c57-671808a706db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59533720-f9a7-499f-9c57-671808a706db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fe2076-1d96-4906-9bc9-8278364b3e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:18 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Volume 2ded1838-ff71-493b-b0b9-c227fd348edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ded1838-ff71-493b-b0b9-c227fd348edb', 'volume_size': 1} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7de3fa91-99c5-44ea-a796-d8f309dc68ba,created_at=2026-08-28T18:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-830117021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7de3fa91-99c5-44ea-a796-d8f309dc68ba,host='devstack@QuobyteHD#QuobyteHD',id=2ded1838-ff71-493b-b0b9-c227fd348edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6224e2b86426469597ce2750ea0149e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:18Z,use_quota=True,user_id='e9298da1c8ba47dca28298949b30651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5f5dbfb-3ea2-4bfc-9467-dba31fbb30c7),volume_type_id=c5f5dbfb-3ea2-4bfc-9467-dba31fbb30c7)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Creating volume 2ded1838-ff71-493b-b0b9-c227fd348edb {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:18 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:18 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb 1073741824 Aug 28 20:22:18 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:18 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb 1073741824" returned: 0 in 0.465s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:18 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb Aug 28 20:22:18 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:18 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fe2076-1d96-4906-9bc9-8278364b3e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ded1838-ff71-493b-b0b9-c227fd348edb', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a85223-4636-4617-9685-475b8e522c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:18 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Volume volume-2ded1838-ff71-493b-b0b9-c227fd348edb (2ded1838-ff71-493b-b0b9-c227fd348edb): created successfully Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a85223-4636-4617-9685-475b8e522c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Flow 'volume_create_manager' (130d0d62-e8fe-44f7-aba3-1459efdd803f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:18 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-30d3a031-b4c2-4466-b8c7-92f8c8fdfbbb tempest-GroupsTest-1723362095 None] Created volume successfully. Aug 28 20:22:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Acquiring lock "cinder-quobyte-2ded1838-ff71-493b-b0b9-c227fd348edb" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Lock "cinder-quobyte-2ded1838-ff71-493b-b0b9-c227fd348edb" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:19 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d4fb89-9fe9-4a37-b110-361b5fc6320e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:20 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb Aug 28 20:22:20 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:20 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb" returned: 0 in 0.389s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:20 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb Aug 28 20:22:20 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:20 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ded1838-ff71-493b-b0b9-c227fd348edb" returned: 0 in 0.260s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Lock "cinder-quobyte-2ded1838-ff71-493b-b0b9-c227fd348edb" released by "delete_volume" :: held 0.698s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Created reservations ['7b619593-a002-4dc3-875f-93549d7b14aa'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:20 devstack cinder-volume[86028]: WARNING cinder.quota [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-483225035 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-483225035, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:22:20 devstack cinder-volume[86028]: WARNING cinder.quota [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-483225035 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-483225035, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Created reservations ['320cfcdc-c6e9-4472-a676-3dac3005c20d', 'e846f9f9-58bb-44f3-a640-042a58d312c4', 'fc2cdd75-5f1f-40a5-ba6c-6da556f73fb2', '4d60e6c4-1a4d-4794-b2aa-cd267e6ded7b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:20 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:20 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=243,cinder:SELECT=179,cinder:DELETE=26,cinder:INSERT=62 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:22:21 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.296s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-98a673e5-86f2-487b-9c0a-9a78ec162b77 tempest-GroupsTest-1723362095 None] Delete group completed successfully. Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-d117c6ae-ba82-4bf1-80d1-e351926704ec tempest-GroupsTest-1723362095 None] Created reservations ['b7b79b00-fbf8-433e-9efe-99988e432d5f'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d117c6ae-ba82-4bf1-80d1-e351926704ec tempest-GroupsTest-1723362095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d117c6ae-ba82-4bf1-80d1-e351926704ec tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d117c6ae-ba82-4bf1-80d1-e351926704ec tempest-GroupsTest-1723362095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d117c6ae-ba82-4bf1-80d1-e351926704ec tempest-GroupsTest-1723362095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d117c6ae-ba82-4bf1-80d1-e351926704ec tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d117c6ae-ba82-4bf1-80d1-e351926704ec tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:21 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:21 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:21 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d117c6ae-ba82-4bf1-80d1-e351926704ec tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.250s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:21 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-d117c6ae-ba82-4bf1-80d1-e351926704ec tempest-GroupsTest-1723362095 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d117c6ae-ba82-4bf1-80d1-e351926704ec tempest-GroupsTest-1723362095 None] Delete group completed successfully. Aug 28 20:22:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3a108893-3c1f-408a-83cb-dc942cae0bd0 tempest-GroupsTest-1723362095 None] Group tempest-GroupsTest-Group-1094148534: creating Aug 28 20:22:22 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=204,cinder:UPDATE=257,cinder:INSERT=56,cinder:DELETE=15 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:22:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3a108893-3c1f-408a-83cb-dc942cae0bd0 tempest-GroupsTest-1723362095 None] Group tempest-GroupsTest-Group-1094148534: created successfully Aug 28 20:22:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3a108893-3c1f-408a-83cb-dc942cae0bd0 tempest-GroupsTest-1723362095 None] Create group completed successfully. Aug 28 20:22:23 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Flow 'volume_create_manager' (fd8b9659-41f2-4a42-aef6-f629e6a4e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:23 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f0e3b2-7752-4ab4-9241-c7fb2bfc8b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f0e3b2-7752-4ab4-9241-c7fb2bfc8b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-850495583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fc619b-c266-493b-8559-ea7f0982adae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3b9d2cdf5e4895a6a1ff849d74eaf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:24Z,use_quota=True,user_id='43e952f27dfe46eaa57c15f74edccabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cfcf65-fbb1-4276-8d9f-5a4525511853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cfcf65-fbb1-4276-8d9f-5a4525511853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2958eab7-25d3-49fa-81e4-c1162bd7604c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2958eab7-25d3-49fa-81e4-c1162bd7604c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4fc619b-c266-493b-8559-ea7f0982adae', 'volume_name': 'volume-f4fc619b-c266-493b-8559-ea7f0982adae', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec257afd-1105-4e8b-bd7a-d6289f72e4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec257afd-1105-4e8b-bd7a-d6289f72e4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7972f97c-84db-477a-951b-8952cacb164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Volume f4fc619b-c266-493b-8559-ea7f0982adae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4fc619b-c266-493b-8559-ea7f0982adae', 'volume_size': 1} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-850495583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fc619b-c266-493b-8559-ea7f0982adae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3b9d2cdf5e4895a6a1ff849d74eaf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:24Z,use_quota=True,user_id='43e952f27dfe46eaa57c15f74edccabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Creating volume f4fc619b-c266-493b-8559-ea7f0982adae {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:24 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:24 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae 1073741824 Aug 28 20:22:24 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Flow 'volume_create_manager' (40d987b8-b562-4849-b302-b7bf764b0624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f268a183-8926-4fcf-82d0-0d44cd67e33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f268a183-8926-4fcf-82d0-0d44cd67e33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-591668898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f19c1b05-a9bb-4751-b008-6c5b0d33c905,host='devstack@QuobyteHD#QuobyteHD',id=9f8c58ba-7ea6-4bb3-afc3-06dffd53b950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6224e2b86426469597ce2750ea0149e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:24Z,use_quota=True,user_id='e9298da1c8ba47dca28298949b30651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ff1b2e8-743f-4e00-92fc-a845818e69bf),volume_type_id=2ff1b2e8-743f-4e00-92fc-a845818e69bf)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef2c8e5-16d5-46dc-8cc9-f0a16547b526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef2c8e5-16d5-46dc-8cc9-f0a16547b526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e136df19-3eba-4e4a-a7c3-4ea4d6eb03d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e136df19-3eba-4e4a-a7c3-4ea4d6eb03d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8c58ba-7ea6-4bb3-afc3-06dffd53b950', 'volume_name': 'volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3319f22c-fc95-4886-98fd-07d1d9ea6147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3319f22c-fc95-4886-98fd-07d1d9ea6147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3e0681-f95e-473e-aee4-99cfc2b64386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Volume 9f8c58ba-7ea6-4bb3-afc3-06dffd53b950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950', 'volume_size': 1} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:24 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae 1073741824" returned: 0 in 0.435s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:24 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae Aug 28 20:22:24 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:24 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae" returned: 0 in 0.244s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f19c1b05-a9bb-4751-b008-6c5b0d33c905,created_at=2026-08-28T18:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-591668898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f19c1b05-a9bb-4751-b008-6c5b0d33c905,host='devstack@QuobyteHD#QuobyteHD',id=9f8c58ba-7ea6-4bb3-afc3-06dffd53b950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6224e2b86426469597ce2750ea0149e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:24Z,use_quota=True,user_id='e9298da1c8ba47dca28298949b30651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ff1b2e8-743f-4e00-92fc-a845818e69bf),volume_type_id=2ff1b2e8-743f-4e00-92fc-a845818e69bf)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Creating volume 9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:24 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7972f97c-84db-477a-951b-8952cacb164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4fc619b-c266-493b-8559-ea7f0982adae', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:24 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 1073741824 Aug 28 20:22:24 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64c68d8-b47c-45b6-b127-0a553b801f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:24 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Volume volume-f4fc619b-c266-493b-8559-ea7f0982adae (f4fc619b-c266-493b-8559-ea7f0982adae): created successfully Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64c68d8-b47c-45b6-b127-0a553b801f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Flow 'volume_create_manager' (fd8b9659-41f2-4a42-aef6-f629e6a4e02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ee765a1e-f7f9-4db5-897f-fdfa1adae0a2 tempest-VolumesTransfersV357Test-1088529246 None] Created volume successfully. Aug 28 20:22:25 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 1073741824" returned: 0 in 0.437s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:25 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 Aug 28 20:22:25 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:25 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3e0681-f95e-473e-aee4-99cfc2b64386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cf991e-4ed5-451b-9d87-14ca5c302470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:25 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Volume volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 (9f8c58ba-7ea6-4bb3-afc3-06dffd53b950): created successfully Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cf991e-4ed5-451b-9d87-14ca5c302470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Flow 'volume_create_manager' (40d987b8-b562-4849-b302-b7bf764b0624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:25 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f708874d-79b9-4a1a-86c3-e15ed58fac81 tempest-VolumesTransfersV357Test-2094541295 None] Transfer volume completed successfully. Aug 28 20:22:25 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e955ca29-a10f-43e2-a4e3-ff05112075c1 tempest-GroupsTest-1723362095 None] Created volume successfully. Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Acquiring lock "cinder-f4fc619b-c266-493b-8559-ea7f0982adae-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Lock "cinder-f4fc619b-c266-493b-8559-ea7f0982adae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Acquiring lock "cinder-quobyte-f4fc619b-c266-493b-8559-ea7f0982adae" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Lock "cinder-quobyte-f4fc619b-c266-493b-8559-ea7f0982adae" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3742df-9e2e-4bb7-9057-c095a32c722c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:26 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae Aug 28 20:22:26 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:26 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae" returned: 0 in 0.347s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:26 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae Aug 28 20:22:26 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:26 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f4fc619b-c266-493b-8559-ea7f0982adae" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Lock "cinder-quobyte-f4fc619b-c266-493b-8559-ea7f0982adae" released by "delete_volume" :: held 0.644s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Created reservations ['b5629e72-43f1-4594-a106-375287ac0b5b', '515aacd6-47fb-4bfd-b581-169bf57a9377', '1b14ebae-227a-4deb-b38d-ff6c49f3f852', '10f41a90-80b3-4312-9795-0288f37a2b74'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:26 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:26 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:27 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.251s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Deleted volume successfully. Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9126d764-f13d-4d7f-b4e2-5d4e8ff2207b tempest-VolumesTransfersV357Test-346086445 None] Lock "cinder-f4fc619b-c266-493b-8559-ea7f0982adae-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Flow 'volume_create_manager' (8829b988-ee6c-4f87-ad35-b496be9d6643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331fd9d5-d985-4671-a15f-abd302af940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331fd9d5-d985-4671-a15f-abd302af940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-354258446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f19c1b05-a9bb-4751-b008-6c5b0d33c905,host='devstack@QuobyteHD#QuobyteHD',id=106d1fc5-2339-4ff8-9097-6ee05163c6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6224e2b86426469597ce2750ea0149e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:27Z,use_quota=True,user_id='e9298da1c8ba47dca28298949b30651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ff1b2e8-743f-4e00-92fc-a845818e69bf),volume_type_id=2ff1b2e8-743f-4e00-92fc-a845818e69bf)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cabda91-0d81-4dca-902d-761a11078bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cabda91-0d81-4dca-902d-761a11078bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654cacd8-3ddc-43cc-bb29-27ceb6ae46ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654cacd8-3ddc-43cc-bb29-27ceb6ae46ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106d1fc5-2339-4ff8-9097-6ee05163c6fd', 'volume_name': 'volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8150a487-1eb6-4a4c-9aff-597a73651fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8150a487-1eb6-4a4c-9aff-597a73651fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4ec934-f977-4a3b-94e5-51c4843715ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:27 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Volume 106d1fc5-2339-4ff8-9097-6ee05163c6fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd', 'volume_size': 1} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f19c1b05-a9bb-4751-b008-6c5b0d33c905,created_at=2026-08-28T18:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-354258446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f19c1b05-a9bb-4751-b008-6c5b0d33c905,host='devstack@QuobyteHD#QuobyteHD',id=106d1fc5-2339-4ff8-9097-6ee05163c6fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6224e2b86426469597ce2750ea0149e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:27Z,use_quota=True,user_id='e9298da1c8ba47dca28298949b30651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ff1b2e8-743f-4e00-92fc-a845818e69bf),volume_type_id=2ff1b2e8-743f-4e00-92fc-a845818e69bf)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Creating volume 106d1fc5-2339-4ff8-9097-6ee05163c6fd {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:27 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:27 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd 1073741824 Aug 28 20:22:27 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Flow 'volume_create_manager' (3bdf529d-1483-42aa-abba-541299ebbeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac68855-5715-4c36-b636-5eddba6b3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:27 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd 1073741824" returned: 0 in 0.471s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac68855-5715-4c36-b636-5eddba6b3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2081312337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e709d24-48a9-44ca-8478-b48cccc172c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3b9d2cdf5e4895a6a1ff849d74eaf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:28Z,use_quota=True,user_id='43e952f27dfe46eaa57c15f74edccabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4c0d90-17ff-4c8d-aa99-bcae6db10f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4c0d90-17ff-4c8d-aa99-bcae6db10f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61fcef0-6135-48cc-9941-0abb56653e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61fcef0-6135-48cc-9941-0abb56653e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e709d24-48a9-44ca-8478-b48cccc172c8', 'volume_name': 'volume-4e709d24-48a9-44ca-8478-b48cccc172c8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d601f7-a442-4ce8-b177-e1f0347c261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d601f7-a442-4ce8-b177-e1f0347c261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67a9c4a-51cf-4f7a-8ed9-29fb312b9280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:27 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Volume 4e709d24-48a9-44ca-8478-b48cccc172c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e709d24-48a9-44ca-8478-b48cccc172c8', 'volume_size': 1} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:28 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd Aug 28 20:22:28 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:28 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2081312337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e709d24-48a9-44ca-8478-b48cccc172c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3b9d2cdf5e4895a6a1ff849d74eaf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:28Z,use_quota=True,user_id='43e952f27dfe46eaa57c15f74edccabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Creating volume 4e709d24-48a9-44ca-8478-b48cccc172c8 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:28 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4ec934-f977-4a3b-94e5-51c4843715ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007ab033-aed4-411f-abb1-84d4a551ee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:28 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8 1073741824 Aug 28 20:22:28 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:28 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Volume volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd (106d1fc5-2339-4ff8-9097-6ee05163c6fd): created successfully Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007ab033-aed4-411f-abb1-84d4a551ee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Flow 'volume_create_manager' (8829b988-ee6c-4f87-ad35-b496be9d6643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-af42ed9a-9781-4598-af05-36e0a210930a tempest-GroupsTest-1723362095 None] Created volume successfully. Aug 28 20:22:28 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8 1073741824" returned: 0 in 0.416s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:28 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8 Aug 28 20:22:28 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-44282c61-b925-4b1d-a8c4-01b51712f038 tempest-GroupsTest-1723362095 None] Update group completed successfully. Aug 28 20:22:28 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8" returned: 0 in 0.249s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67a9c4a-51cf-4f7a-8ed9-29fb312b9280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e709d24-48a9-44ca-8478-b48cccc172c8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803f33ab-402a-4e1e-a6fa-b306edd16422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:28 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Volume volume-4e709d24-48a9-44ca-8478-b48cccc172c8 (4e709d24-48a9-44ca-8478-b48cccc172c8): created successfully Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803f33ab-402a-4e1e-a6fa-b306edd16422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Flow 'volume_create_manager' (3bdf529d-1483-42aa-abba-541299ebbeb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:29 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-73ba910c-1570-42d5-aec4-e18cddc06c40 tempest-VolumesTransfersV357Test-1088529246 None] Created volume successfully. Aug 28 20:22:30 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2763db15-be62-4e6f-a75b-bd7387ecb61d tempest-GroupsTest-1723362095 None] Update group completed successfully. Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Acquiring lock "cinder-4e709d24-48a9-44ca-8478-b48cccc172c8-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Lock "cinder-4e709d24-48a9-44ca-8478-b48cccc172c8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Acquiring lock "cinder-quobyte-4e709d24-48a9-44ca-8478-b48cccc172c8" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Lock "cinder-quobyte-4e709d24-48a9-44ca-8478-b48cccc172c8" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a95372a-071a-4430-b685-2cc434bfd9fe]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:30 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8 Aug 28 20:22:30 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:30 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8" returned: 0 in 0.344s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:30 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8 Aug 28 20:22:30 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:30 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4e709d24-48a9-44ca-8478-b48cccc172c8" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Lock "cinder-quobyte-4e709d24-48a9-44ca-8478-b48cccc172c8" released by "delete_volume" :: held 0.624s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Created reservations ['0567493c-bfcd-4c14-8c87-34d1a3a152f4', '9401f137-f024-4b60-9561-7ad941e42d7e', '44aa9c53-ea50-4fc0-b2b3-2b8f387cc874', '576e158d-05c6-42b0-809d-6ca34a522db4'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:30 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:30 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:31 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.248s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:31 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:31 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Deleted volume successfully. Aug 28 20:22:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-275fab51-add0-48da-8f51-b5ed703a4f89 tempest-VolumesTransfersV357Test-346086445 None] Lock "cinder-4e709d24-48a9-44ca-8478-b48cccc172c8-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Acquiring lock "cinder-quobyte-106d1fc5-2339-4ff8-9097-6ee05163c6fd" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Lock "cinder-quobyte-106d1fc5-2339-4ff8-9097-6ee05163c6fd" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:31 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5960807b-2c5c-4c40-8e59-995fd77e4aac]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:31 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd Aug 28 20:22:31 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:32 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd" returned: 0 in 0.368s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:32 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd Aug 28 20:22:32 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:32 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-106d1fc5-2339-4ff8-9097-6ee05163c6fd" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Lock "cinder-quobyte-106d1fc5-2339-4ff8-9097-6ee05163c6fd" released by "delete_volume" :: held 0.654s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Acquiring lock "cinder-quobyte-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Lock "cinder-quobyte-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:32 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5d4854-a792-4ae5-adbf-3199a0b07a58]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:32 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 Aug 28 20:22:32 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:32 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950" returned: 0 in 0.363s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:32 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950 Aug 28 20:22:32 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:33 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950" returned: 0 in 0.274s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Lock "cinder-quobyte-9f8c58ba-7ea6-4bb3-afc3-06dffd53b950" released by "delete_volume" :: held 0.677s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Created reservations ['72b29313-bc74-4439-816c-0d49c22dbcc8'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:33 devstack cinder-volume[86028]: WARNING cinder.quota [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1951502085 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1951502085, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:22:33 devstack cinder-volume[86028]: WARNING cinder.quota [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1951502085 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1951502085, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Created reservations ['5ab7424f-bbe6-4061-8ebc-e41bcaa5f222', '8d5adaec-4434-474c-82ba-24691bea68ec', '155a2b6c-ac09-4502-9d51-45521faec47d', '6ae23678-8054-4a51-b1aa-2e8acf131e7e'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Created reservations ['caec2da7-ed82-449b-8117-8d31f2569862', 'd51ced86-16bb-459b-97e6-80a1b2ded38c', 'dd9a5d3c-a1ea-4b16-8e15-2a81aec85d17', '7d29430e-eacb-4af2-b3f6-b9b808651eae'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:33 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:33 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:33 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.270s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:33 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ff2234d7-31e0-4dff-81ac-f70644acfc36 tempest-GroupsTest-1723362095 None] Delete group completed successfully. Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (e741fe63-8b67-4a23-8b86-4c7870ed2b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80e7ca3-a158-4fcd-ae08-dbf1976ebb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80e7ca3-a158-4fcd-ae08-dbf1976ebb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1568026363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88a4a28-f2bc-4089-a24a-731b5680e486,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:37Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3710b61-6560-4d61-8fff-eade654671ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3710b61-6560-4d61-8fff-eade654671ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dabdf7-7f5b-48eb-bbaa-3ed7ee299496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dabdf7-7f5b-48eb-bbaa-3ed7ee299496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88a4a28-f2bc-4089-a24a-731b5680e486', 'volume_name': 'volume-a88a4a28-f2bc-4089-a24a-731b5680e486', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a158a41-100f-48b9-a6de-5973230845b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a158a41-100f-48b9-a6de-5973230845b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da328920-bc4a-48bb-b6e7-5405f7cf4bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Volume a88a4a28-f2bc-4089-a24a-731b5680e486: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88a4a28-f2bc-4089-a24a-731b5680e486', 'volume_size': 1} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1568026363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88a4a28-f2bc-4089-a24a-731b5680e486,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:37Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Creating volume a88a4a28-f2bc-4089-a24a-731b5680e486 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:36 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:36 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486 1073741824 Aug 28 20:22:36 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:37 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486 1073741824" returned: 0 in 0.445s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:37 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486 Aug 28 20:22:37 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:37 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da328920-bc4a-48bb-b6e7-5405f7cf4bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88a4a28-f2bc-4089-a24a-731b5680e486', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90cb8b4-537e-4f0a-bee1-2222d6c404a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:37 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Volume volume-a88a4a28-f2bc-4089-a24a-731b5680e486 (a88a4a28-f2bc-4089-a24a-731b5680e486): created successfully Aug 28 20:22:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90cb8b4-537e-4f0a-bee1-2222d6c404a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (e741fe63-8b67-4a23-8b86-4c7870ed2b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:37 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fee492d2-fef5-4055-9069-8e99252e2e57 tempest-VolumesGetTest-1211406823 None] Created volume successfully. Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (80da5294-e080-4077-bb76-e72e3a77f66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d13a06e-b1c5-4bca-b2d8-3e8bc27785ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d13a06e-b1c5-4bca-b2d8-3e8bc27785ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-194115720',display_name='tempest-VolumesGetTest-Volume-1016511849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7e005a-512b-470b-a5b7-999dcf23ed2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:38Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e89daf9-3b06-4ec8-bd6f-b7da9e7b2ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e89daf9-3b06-4ec8-bd6f-b7da9e7b2ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe26fa2-3e60-4586-8b90-befd0589d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe26fa2-3e60-4586-8b90-befd0589d6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7e005a-512b-470b-a5b7-999dcf23ed2a', 'volume_name': 'volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b925a9b8-905b-4679-a794-4e9fb27a178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b925a9b8-905b-4679-a794-4e9fb27a178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30eb1bc5-4fe6-47c9-af63-9bc32039b54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:38 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Volume cb7e005a-512b-470b-a5b7-999dcf23ed2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a', 'volume_size': 1} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-194115720',display_name='tempest-VolumesGetTest-Volume-1016511849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7e005a-512b-470b-a5b7-999dcf23ed2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:38Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Creating volume cb7e005a-512b-470b-a5b7-999dcf23ed2a {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:38 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:38 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a 1073741824 Aug 28 20:22:38 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:39 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a 1073741824" returned: 0 in 0.507s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:39 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a Aug 28 20:22:39 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:39 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a" returned: 0 in 0.266s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30eb1bc5-4fe6-47c9-af63-9bc32039b54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f113f50-ba15-41d6-ad89-39b231aaceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:39 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Volume volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a (cb7e005a-512b-470b-a5b7-999dcf23ed2a): created successfully Aug 28 20:22:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f113f50-ba15-41d6-ad89-39b231aaceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (80da5294-e080-4077-bb76-e72e3a77f66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-af89576f-635b-43e0-af08-fcf0f42afe82 tempest-VolumesGetTest-1211406823 None] Created volume successfully. Aug 28 20:22:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-cb7e005a-512b-470b-a5b7-999dcf23ed2a-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Lock "cinder-cb7e005a-512b-470b-a5b7-999dcf23ed2a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-quobyte-cb7e005a-512b-470b-a5b7-999dcf23ed2a" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-cb7e005a-512b-470b-a5b7-999dcf23ed2a" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:40 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[52631ccd-5f33-4852-948e-cb6c23a4d739]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:40 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a Aug 28 20:22:40 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:41 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a" returned: 0 in 0.389s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:41 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a Aug 28 20:22:41 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:41 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-cb7e005a-512b-470b-a5b7-999dcf23ed2a" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-cb7e005a-512b-470b-a5b7-999dcf23ed2a" released by "delete_volume" :: held 0.678s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Created reservations ['01ea1c0d-466a-4091-b600-047a09607690', '27048288-3734-41fa-a7d1-550f549404d3', 'dd206b16-76c1-4bb7-8216-6165cc09e031', 'd24d3bca-f883-4234-a72d-2d045f71cf51'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:41 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:41 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:41 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.281s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Deleted volume successfully. Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-222a9911-19e9-4e0a-9c1c-08c4430ce412 tempest-VolumesGetTest-1211406823 None] Lock "cinder-cb7e005a-512b-470b-a5b7-999dcf23ed2a-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-a88a4a28-f2bc-4089-a24a-731b5680e486-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Lock "cinder-a88a4a28-f2bc-4089-a24a-731b5680e486-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-quobyte-a88a4a28-f2bc-4089-a24a-731b5680e486" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-a88a4a28-f2bc-4089-a24a-731b5680e486" acquired by "delete_volume" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34e3b85-4908-4c8e-8203-fda408b28ee4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:42 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486 Aug 28 20:22:42 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:42 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486" returned: 0 in 0.377s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:42 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486 Aug 28 20:22:42 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:42 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a88a4a28-f2bc-4089-a24a-731b5680e486" returned: 0 in 0.262s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-a88a4a28-f2bc-4089-a24a-731b5680e486" released by "delete_volume" :: held 0.681s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Created reservations ['b6759111-be1e-4f61-9178-0ffa79a25d1e', 'a1db2730-7d4b-4393-80cf-700e5dc9f778', '2e8c7fa6-2047-466e-b67b-bc90e3464086', '541545b3-8ee3-4e5c-83c5-5ec82dc2d8dd'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:42 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:42 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:43 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:43 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Deleted volume successfully. Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-11f985b7-f274-4e1d-a6cb-e1b004a1120a tempest-VolumesGetTest-1211406823 None] Lock "cinder-a88a4a28-f2bc-4089-a24a-731b5680e486-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (0e674f19-469b-4b46-9b48-39eb98c98922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb9a261-9c9c-4dde-967b-b133d77d3ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb9a261-9c9c-4dde-967b-b133d77d3ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1142018446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae5d829-723a-4725-bfaf-9077bf8b5b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:44Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b37acf2-f68a-4fd6-8fc2-bc37b68e20fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b37acf2-f68a-4fd6-8fc2-bc37b68e20fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155d9fa3-95d1-4619-8a8e-f3a0d1371947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155d9fa3-95d1-4619-8a8e-f3a0d1371947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae5d829-723a-4725-bfaf-9077bf8b5b49', 'volume_name': 'volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39dd9b8a-2c3d-4d11-b19c-d456639593ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39dd9b8a-2c3d-4d11-b19c-d456639593ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209b9579-4763-4fd4-bd21-02e702346c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:43 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Volume 3ae5d829-723a-4725-bfaf-9077bf8b5b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49', 'volume_size': 1} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1142018446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae5d829-723a-4725-bfaf-9077bf8b5b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:44Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Creating volume 3ae5d829-723a-4725-bfaf-9077bf8b5b49 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:43 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:43 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 1073741824 Aug 28 20:22:43 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:44 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 1073741824" returned: 0 in 0.502s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:44 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 Aug 28 20:22:44 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:44 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209b9579-4763-4fd4-bd21-02e702346c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64025d8-8bd5-4819-babc-ec58ab3dd75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:44 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Volume volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 (3ae5d829-723a-4725-bfaf-9077bf8b5b49): created successfully Aug 28 20:22:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64025d8-8bd5-4819-babc-ec58ab3dd75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (0e674f19-469b-4b46-9b48-39eb98c98922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:44 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f21804ec-9a2f-47ff-9468-9b4922d8372c tempest-VolumesGetTest-1211406823 None] Created volume successfully. Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (e76211a7-76da-4ed9-9269-1de0c4c1e9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47685334-2847-4536-a44b-b1ea205abe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47685334-2847-4536-a44b-b1ea205abe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-715666702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14de8bad-0624-47a1-9140-464bf8ae85ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3ae5d829-723a-4725-bfaf-9077bf8b5b49,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:46Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4f943f-105b-44dc-9436-c1491eeaf30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4f943f-105b-44dc-9436-c1491eeaf30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b0b6ec-7be0-4abf-91eb-13e5dba69d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b0b6ec-7be0-4abf-91eb-13e5dba69d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '14de8bad-0624-47a1-9140-464bf8ae85ea', 'volume_name': 'volume-14de8bad-0624-47a1-9140-464bf8ae85ea', 'volume_size': 1, 'source_volid': '3ae5d829-723a-4725-bfaf-9077bf8b5b49', 'source_volstatus': 'available'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442e82bc-38a8-40d2-8085-2dcfe3953099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442e82bc-38a8-40d2-8085-2dcfe3953099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbd2ee3-dae7-4066-9d82-b8ed04427346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:46 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Volume 14de8bad-0624-47a1-9140-464bf8ae85ea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-14de8bad-0624-47a1-9140-464bf8ae85ea', 'volume_size': 1, 'source_volid': '3ae5d829-723a-4725-bfaf-9077bf8b5b49', 'source_volstatus': 'available'} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:46 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Cloning volume 3ae5d829-723a-4725-bfaf-9077bf8b5b49 to volume 14de8bad-0624-47a1-9140-464bf8ae85ea Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Creating offline snapshot 3856c872-73a7-40c7-ac7c-2d29d0c030e5 of volume 3ae5d829-723a-4725-bfaf-9077bf8b5b49 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe1c1fb-3f77-46a9-951a-491d07d8436f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:46 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 Aug 28 20:22:46 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:46 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49" returned: 0 in 0.388s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:46 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 1G Aug 28 20:22:46 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:47 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 1G" returned: 0 in 0.429s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:47 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 Aug 28 20:22:47 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:47 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5" returned: 0 in 0.285s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:47 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 is being set with open permissions: ugo+rw Aug 28 20:22:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:47 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 Aug 28 20:22:47 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:47 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:47 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.info Aug 28 20:22:47 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Flow 'volume_create_manager' (35f1a9d2-a111-4d35-a4fe-94a06710b78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9d5226-03cd-45bf-b185-77808cdf63ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:48 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.info" returned: 0 in 0.280s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:48 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.info is being set with open permissions: ugo+rw Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9d5226-03cd-45bf-b185-77808cdf63ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1098591031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3bc056-1abb-41bd-a5b3-4f39287362a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d934e22abce4503a1d703d0c64c7d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:48Z,use_quota=True,user_id='69a10d73b1de47a2952881455064ce3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:48 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.info Aug 28 20:22:48 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84feb57-636b-4f8d-8970-75b943c20369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84feb57-636b-4f8d-8970-75b943c20369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b79e91-3561-428f-84ee-aea3969002b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b79e91-3561-428f-84ee-aea3969002b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3bc056-1abb-41bd-a5b3-4f39287362a8', 'volume_name': 'volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca81ad25-dda3-4cad-a12c-919de46bd611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca81ad25-dda3-4cad-a12c-919de46bd611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311df727-b961-41b6-b377-1891d356bfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:48 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Volume 6d3bc056-1abb-41bd-a5b3-4f39287362a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8', 'volume_size': 1} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:48 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.info" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-quobyte-14de8bad-0624-47a1-9140-464bf8ae85ea" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-14de8bad-0624-47a1-9140-464bf8ae85ea" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] snapshot: 3856c872-73a7-40c7-ac7c-2d29d0c030e5, volume: 14de8bad-0624-47a1-9140-464bf8ae85ea, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1e8752-92f3-49e5-a3f2-e182b6cd128a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:48 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 Aug 28 20:22:48 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:48 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5" returned: 0 in 0.341s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f2d770-993e-422d-a0d7-234b0c04788c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:48 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 Aug 28 20:22:48 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:49 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49" returned: 0 in 0.347s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:22:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:22:49 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:22:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:49 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea Aug 28 20:22:49 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:53 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea" returned: 0 in 4.085s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:22:53 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Converted 1024.00 MB image at 250.62 MB/s Aug 28 20:22:53 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea is being set with open permissions: ugo+rw Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:53 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea Aug 28 20:22:53 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:53 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-14de8bad-0624-47a1-9140-464bf8ae85ea" released by "_copy_volume_from_snapshot" :: held 5.075s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-quobyte-3856c872-73a7-40c7-ac7c-2d29d0c030e5" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-3856c872-73a7-40c7-ac7c-2d29d0c030e5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Deleting offline snapshot 3856c872-73a7-40c7-ac7c-2d29d0c030e5 of volume 3ae5d829-723a-4725-bfaf-9077bf8b5b49 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] snapshot_file for this snap is: volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf66c2f4-2173-4cc2-be56-8a898b39a62f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:53 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 Aug 28 20:22:53 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:53 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5" returned: 0 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f2b6c0-e66f-400e-aa2d-369aeababcff]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:53 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 Aug 28 20:22:53 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:54 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49" returned: 0 in 0.539s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:54 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 Aug 28 20:22:54 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:54 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5" returned: 0 in 0.313s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:54 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5 Aug 28 20:22:54 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:54 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49.3856c872-73a7-40c7-ac7c-2d29d0c030e5" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-3856c872-73a7-40c7-ac7c-2d29d0c030e5" released by "_delete_snapshot" :: held 1.527s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.660s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.872s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1098591031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3bc056-1abb-41bd-a5b3-4f39287362a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d934e22abce4503a1d703d0c64c7d38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:48Z,use_quota=True,user_id='69a10d73b1de47a2952881455064ce3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Creating volume 6d3bc056-1abb-41bd-a5b3-4f39287362a8 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:55 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbd2ee3-dae7-4066-9d82-b8ed04427346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14de8bad-0624-47a1-9140-464bf8ae85ea', 'volume_size': 1, 'source_volid': '3ae5d829-723a-4725-bfaf-9077bf8b5b49', 'source_volstatus': 'available'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:55 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8 1073741824 Aug 28 20:22:55 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21733d2-e30d-4424-ba77-5348f7cc4b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:55 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Volume volume-14de8bad-0624-47a1-9140-464bf8ae85ea (14de8bad-0624-47a1-9140-464bf8ae85ea): created successfully Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21733d2-e30d-4424-ba77-5348f7cc4b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (e76211a7-76da-4ed9-9269-1de0c4c1e9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f9eda490-45bd-4fcb-b296-a17fc2a59574 tempest-VolumesGetTest-1211406823 None] Created volume successfully. Aug 28 20:22:55 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8 1073741824" returned: 0 in 0.410s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:55 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8 Aug 28 20:22:55 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:55 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311df727-b961-41b6-b377-1891d356bfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f395f36-7a41-468f-86f9-ba666253c6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:55 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Volume volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8 (6d3bc056-1abb-41bd-a5b3-4f39287362a8): created successfully Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f395f36-7a41-468f-86f9-ba666253c6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Flow 'volume_create_manager' (35f1a9d2-a111-4d35-a4fe-94a06710b78d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c3a931ae-bc2f-48f6-96b6-9b9c2f6ed7d2 tempest-VolumesMetadataTest-1759847330 None] Created volume successfully. Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (ebdf58bf-2f22-4b5a-9515-e6255b93e825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d19e2e-99dd-4012-a087-6fc366aab826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d19e2e-99dd-4012-a087-6fc366aab826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-236946117',display_name='tempest-VolumesGetTest-Volume-1018997470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cc5442-04c7-46cf-b4c2-9cc413a5cf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:57Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf1200b-3666-43f9-8276-6950f05c8b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf1200b-3666-43f9-8276-6950f05c8b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717ba021-d816-4efa-8287-be08d8ded91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717ba021-d816-4efa-8287-be08d8ded91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4cc5442-04c7-46cf-b4c2-9cc413a5cf24', 'volume_name': 'volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14248c2-2c8a-44d1-bb59-cc6e27932727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14248c2-2c8a-44d1-bb59-cc6e27932727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b15312-d096-4340-8387-5f35bb69c0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:56 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Volume c4cc5442-04c7-46cf-b4c2-9cc413a5cf24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24', 'volume_size': 1} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:22:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-236946117',display_name='tempest-VolumesGetTest-Volume-1018997470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cc5442-04c7-46cf-b4c2-9cc413a5cf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:22:57Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Creating volume c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:22:56 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:22:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:56 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 1073741824 Aug 28 20:22:56 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:57 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 1073741824" returned: 0 in 0.441s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:57 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 Aug 28 20:22:57 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Acquiring lock "cinder-6d3bc056-1abb-41bd-a5b3-4f39287362a8-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:57 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Lock "cinder-6d3bc056-1abb-41bd-a5b3-4f39287362a8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24" returned: 0 in 0.256s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b15312-d096-4340-8387-5f35bb69c0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402d2a6a-6817-4777-aa42-f6dac6076fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:22:57 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Volume volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 (c4cc5442-04c7-46cf-b4c2-9cc413a5cf24): created successfully Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402d2a6a-6817-4777-aa42-f6dac6076fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (ebdf58bf-2f22-4b5a-9515-e6255b93e825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Acquiring lock "cinder-quobyte-6d3bc056-1abb-41bd-a5b3-4f39287362a8" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2a0422cd-ec34-40e4-a1a1-efa10146d8c9 tempest-VolumesGetTest-1211406823 None] Created volume successfully. Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Lock "cinder-quobyte-6d3bc056-1abb-41bd-a5b3-4f39287362a8" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d2930-b36c-4c1f-b6d8-b0738c0ad84f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:57 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8 Aug 28 20:22:57 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Lock "cinder-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-quobyte-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6741363-ecb6-4d7b-be86-c8efbc5f5132]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:57 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8" returned: 0 in 0.371s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:57 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8 Aug 28 20:22:57 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:57 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 Aug 28 20:22:57 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:58 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6d3bc056-1abb-41bd-a5b3-4f39287362a8" returned: 0 in 0.265s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Lock "cinder-quobyte-6d3bc056-1abb-41bd-a5b3-4f39287362a8" released by "delete_volume" :: held 0.680s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:58 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24" returned: 0 in 0.362s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Created reservations ['e64f09f8-45f8-4ffc-80e7-3fc182f0a699', 'c5fa84ae-b2ac-4f97-b1d4-646f953cc3a9', '6d665246-2edd-4dc7-84a3-166749dbebf8', '603105a1-01c9-4fc1-91b3-365935bbd3cc'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:58 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24 Aug 28 20:22:58 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:58 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:58 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:58 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24" returned: 0 in 0.237s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24" released by "delete_volume" :: held 0.645s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Created reservations ['92260091-6dc2-493e-ab59-adf76d5d9640', '930ed595-4df0-42a8-a9e5-af6c0659cc60', 'b6981888-36c9-4c21-839e-c9cc90b2e6f4', '1bbfcfc2-6026-4122-9968-8762fbcc9985'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:58 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.267s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:58 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Deleted volume successfully. Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-01bcd58f-3649-456d-b08e-6be49e02eab2 tempest-VolumesMetadataTest-1759847330 None] Lock "cinder-6d3bc056-1abb-41bd-a5b3-4f39287362a8-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:58 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:58 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:58 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.266s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:22:58 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Deleted volume successfully. Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aff3e6e3-b9ed-4285-9899-6fd0e0c763f9 tempest-VolumesGetTest-1211406823 None] Lock "cinder-c4cc5442-04c7-46cf-b4c2-9cc413a5cf24-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-14de8bad-0624-47a1-9140-464bf8ae85ea-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Lock "cinder-14de8bad-0624-47a1-9140-464bf8ae85ea-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-quobyte-14de8bad-0624-47a1-9140-464bf8ae85ea" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-14de8bad-0624-47a1-9140-464bf8ae85ea" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da0af62-f434-4b5b-ae8f-5618955a7271]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:59 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea Aug 28 20:22:59 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:59 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea" returned: 0 in 0.381s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:59 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea Aug 28 20:22:59 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:22:59 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14de8bad-0624-47a1-9140-464bf8ae85ea" returned: 0 in 0.257s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-14de8bad-0624-47a1-9140-464bf8ae85ea" released by "delete_volume" :: held 0.679s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Created reservations ['f5abdf1c-4eed-4c9c-9d7f-3ac7ccb60301', '4e0d996a-e14a-4bbb-a84d-c66df4f8d0ad', 'ee542b8e-4724-4914-9f22-43f4fec889cb', 'c91fc67a-1a9e-476c-82ca-80f35318d366'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:22:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:22:59 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:22:59 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:00 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.256s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:23:00 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Deleted volume successfully. Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ab698f5c-217e-405b-bffb-808e7f19c3b4 tempest-VolumesGetTest-1211406823 None] Lock "cinder-14de8bad-0624-47a1-9140-464bf8ae85ea-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-3ae5d829-723a-4725-bfaf-9077bf8b5b49-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Lock "cinder-3ae5d829-723a-4725-bfaf-9077bf8b5b49-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-quobyte-3ae5d829-723a-4725-bfaf-9077bf8b5b49" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-3ae5d829-723a-4725-bfaf-9077bf8b5b49" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcb584c-c863-4ecd-9a2d-e6544fe92c8c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:00 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 Aug 28 20:23:00 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:00 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49" returned: 0 in 0.379s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:00 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49 Aug 28 20:23:00 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:00 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3ae5d829-723a-4725-bfaf-9077bf8b5b49" returned: 0 in 0.258s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-3ae5d829-723a-4725-bfaf-9077bf8b5b49" released by "delete_volume" :: held 0.697s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:01 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Created reservations ['c4f433f9-53d5-4b28-9616-01583d20a151', 'baa59238-5d39-4f92-ae12-4a79afe0f280', '6a098df1-71ee-4dba-b0b3-0d0a66eaebe6', '92d406aa-d24d-4b10-bc50-bcf5d81ba9a7'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:23:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:23:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:23:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:01 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:23:01 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:01 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.287s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:01 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:23:01 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Deleted volume successfully. Aug 28 20:23:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9817468d-6e1e-47d8-89ac-8ed296805751 tempest-VolumesGetTest-1211406823 None] Lock "cinder-3ae5d829-723a-4725-bfaf-9077bf8b5b49-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (e23181df-d07e-4caa-888f-87ef16857d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8780000-831b-4b82-91d5-9f3a03478743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8780000-831b-4b82-91d5-9f3a03478743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1721211558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c851b79c-b600-4eb0-a899-0ab5c46c07d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:23:02Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46d4d97-fdcb-4d23-b528-4d9ca6a3c590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46d4d97-fdcb-4d23-b528-4d9ca6a3c590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8759f84-865b-4485-989c-549d1a898175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.image.glance [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Creating Keystone auth plugin from conf {{(pid=86028) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8759f84-865b-4485-989c-549d1a898175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c851b79c-b600-4eb0-a899-0ab5c46c07d6', 'volume_name': 'volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b94364-708d-475a-97d0-950f9d50f39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b94364-708d-475a-97d0-950f9d50f39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de9ccd1-5633-476c-9a57-9429ee76661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:02 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Volume c851b79c-b600-4eb0-a899-0ab5c46c07d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Trying to clone c851b79c-b600-4eb0-a899-0ab5c46c07d6 from image b69357c8-f1c6-42fd-802c-792fbb69d92d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]). {{(pid=86028) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 20:23:02 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Image download 20.69 MB at 20.69 MB/s Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36e1b20-85a5-4fc8-8a5b-910f4ec75263]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:03 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD Aug 28 20:23:03 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:03 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Temporary image b69357c8-f1c6-42fd-802c-792fbb69d92d is fetched for user 8a370ced2d354f939a393b0a81ee16d8. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ef55ad-c2fb-4090-a016-8612e04352eb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:03 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD Aug 28 20:23:03 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:03 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1721211558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c851b79c-b600-4eb0-a899-0ab5c46c07d6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:23:02Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Creating volume c851b79c-b600-4eb0-a899-0ab5c46c07d6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:23:03 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:23:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:03 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 1073741824 Aug 28 20:23:03 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:04 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 1073741824" returned: 0 in 0.460s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:04 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 Aug 28 20:23:04 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:04 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6" returned: 0 in 0.254s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:23:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:04 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Attempting download of b69357c8-f1c6-42fd-802c-792fbb69d92d ((None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}])) to volume c851b79c-b600-4eb0-a899-0ab5c46c07d6. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 20:23:04 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fefe6c-e657-4498-9a30-a1ec53ef9d6b]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_lnquwjzp {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:04 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_lnquwjzp Aug 28 20:23:04 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:04 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_lnquwjzp" returned: 0 in 0.332s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_lnquwjzp {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:04 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_lnquwjzp Aug 28 20:23:04 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:05 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_lnquwjzp" returned: 1 in 0.357s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_lnquwjzp' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:23:05 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d26adf-fc0e-43f5-858a-43fc254ac8d1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:05 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD Aug 28 20:23:05 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:05 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:05 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] b69357c8-f1c6-42fd-802c-792fbb69d92d was qcow2, converting to qcow2 {{(pid=86028) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 20:23:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:05 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 Aug 28 20:23:05 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:06 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:23:06 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:06 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:23:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:23:07 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6" returned: 0 in 1.911s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_w1g4vsb_devstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:23:07 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Converted 112.00 MB image at 58.58 MB/s Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:07 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 1G Aug 28 20:23:07 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:07 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 1G" returned: 0 in 0.372s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Downloaded image b69357c8-f1c6-42fd-802c-792fbb69d92d ((None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}])) to volume c851b79c-b600-4eb0-a899-0ab5c46c07d6 successfully. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Temporary image b69357c8-f1c6-42fd-802c-792fbb69d92d for user 8a370ced2d354f939a393b0a81ee16d8 is deleted. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Marking volume c851b79c-b600-4eb0-a899-0ab5c46c07d6 as bootable. {{(pid=86028) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Copying metadata from image b69357c8-f1c6-42fd-802c-792fbb69d92d to c851b79c-b600-4eb0-a899-0ab5c46c07d6. {{(pid=86028) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Creating volume glance metadata for volume c851b79c-b600-4eb0-a899-0ab5c46c07d6 backed by image b69357c8-f1c6-42fd-802c-792fbb69d92d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86028) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de9ccd1-5633-476c-9a57-9429ee76661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118ba99b-eaca-40dc-9649-9b832bc7ef7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:07 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Volume volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 (c851b79c-b600-4eb0-a899-0ab5c46c07d6): created successfully Aug 28 20:23:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118ba99b-eaca-40dc-9649-9b832bc7ef7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (e23181df-d07e-4caa-888f-87ef16857d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:23:08 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6475809b-9898-4bf3-ada3-dc1a99b5a9b1 tempest-VolumesGetTest-1211406823 None] Created volume successfully. Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (001756c5-510c-4123-b878-d8d0184f0174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb29e0ce-3ba2-4de3-a50a-b31fdd5f5c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb29e0ce-3ba2-4de3-a50a-b31fdd5f5c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:23:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1468638846',display_name='tempest-VolumesGetTest-Volume-1093004391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23abcf38-dfd9-409b-9bd9-9c33a01b770b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:23:09Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4958a92c-ddbc-43ec-b198-18b35609a20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4958a92c-ddbc-43ec-b198-18b35609a20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546f2d88-1b76-41f2-869b-1e149c93bd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546f2d88-1b76-41f2-869b-1e149c93bd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23abcf38-dfd9-409b-9bd9-9c33a01b770b', 'volume_name': 'volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febe593e-ef1a-441c-b700-5f499f539fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febe593e-ef1a-441c-b700-5f499f539fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e32e78-5a04-4425-b31c-6dcd571e5019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:09 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Volume 23abcf38-dfd9-409b-9bd9-9c33a01b770b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b', 'volume_size': 1} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:23:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1468638846',display_name='tempest-VolumesGetTest-Volume-1093004391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23abcf38-dfd9-409b-9bd9-9c33a01b770b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fd1c56bf404ee8b0e8798e820a9e40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:23:09Z,use_quota=True,user_id='8a370ced2d354f939a393b0a81ee16d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Creating volume 23abcf38-dfd9-409b-9bd9-9c33a01b770b {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:23:09 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:09 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b 1073741824 Aug 28 20:23:09 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:09 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b 1073741824" returned: 0 in 0.463s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:09 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b Aug 28 20:23:09 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:10 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b" returned: 0 in 0.279s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:23:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e32e78-5a04-4425-b31c-6dcd571e5019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b97d9a-f13b-472b-b8d5-50acc651deb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:10 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Volume volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b (23abcf38-dfd9-409b-9bd9-9c33a01b770b): created successfully Aug 28 20:23:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b97d9a-f13b-472b-b8d5-50acc651deb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Flow 'volume_create_manager' (001756c5-510c-4123-b878-d8d0184f0174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:23:10 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3be22581-8752-4baa-b9db-e0bbc979509f tempest-VolumesGetTest-1211406823 None] Created volume successfully. Aug 28 20:23:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-23abcf38-dfd9-409b-9bd9-9c33a01b770b-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Lock "cinder-23abcf38-dfd9-409b-9bd9-9c33a01b770b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-quobyte-23abcf38-dfd9-409b-9bd9-9c33a01b770b" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-23abcf38-dfd9-409b-9bd9-9c33a01b770b" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:11 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8f7b3a-4dcc-4a7d-bd0a-078ed2d3f7fd]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:11 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b Aug 28 20:23:11 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:11 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b" returned: 0 in 0.383s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:11 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b Aug 28 20:23:11 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:12 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-23abcf38-dfd9-409b-9bd9-9c33a01b770b" returned: 0 in 0.268s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-23abcf38-dfd9-409b-9bd9-9c33a01b770b" released by "delete_volume" :: held 0.695s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Created reservations ['38a9341d-ad9f-45b7-a02b-64c4ca3c8ab1', '3c63111e-2cbb-488c-833e-b9e04746cf5c', '25efdf33-5835-4ae8-971e-e36ccbfa093e', '36a75298-18cf-4f2b-8f1f-ab747c77fab9'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:12 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:23:12 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:12 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.287s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:23:12 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Deleted volume successfully. Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c7997f56-97cf-4114-9c2a-69828ecf501a tempest-VolumesGetTest-1211406823 None] Lock "cinder-23abcf38-dfd9-409b-9bd9-9c33a01b770b-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-c851b79c-b600-4eb0-a899-0ab5c46c07d6-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Lock "cinder-c851b79c-b600-4eb0-a899-0ab5c46c07d6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Flow 'volume_create_manager' (28e4aaa6-ecff-422f-a947-28062e0fc32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838b3d24-4b97-40ee-b102-7e7b1d7fac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838b3d24-4b97-40ee-b102-7e7b1d7fac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-724416582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040b73eb-c5dc-400b-b75c-6998f625346d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1be33d23ae4cd3be283f4e58b6484e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:23:13Z,use_quota=True,user_id='f44b9a96728047d08b514a5a7dbe3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c0450f-fa15-4311-9c16-952d52066f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c0450f-fa15-4311-9c16-952d52066f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784f089e-0068-4041-a8e8-40c744081255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784f089e-0068-4041-a8e8-40c744081255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040b73eb-c5dc-400b-b75c-6998f625346d', 'volume_name': 'volume-040b73eb-c5dc-400b-b75c-6998f625346d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aada256-6517-4aee-86b6-611cea6852b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aada256-6517-4aee-86b6-611cea6852b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504406c7-ff8f-418f-a0c2-65da1cf9ca13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:12 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Volume 040b73eb-c5dc-400b-b75c-6998f625346d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040b73eb-c5dc-400b-b75c-6998f625346d', 'volume_size': 1} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-724416582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040b73eb-c5dc-400b-b75c-6998f625346d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1be33d23ae4cd3be283f4e58b6484e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:23:13Z,use_quota=True,user_id='f44b9a96728047d08b514a5a7dbe3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Creating volume 040b73eb-c5dc-400b-b75c-6998f625346d {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:23:12 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:12 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d 1073741824 Aug 28 20:23:12 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Acquiring lock "cinder-quobyte-c851b79c-b600-4eb0-a899-0ab5c46c07d6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-c851b79c-b600-4eb0-a899-0ab5c46c07d6" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94075eb-1a66-4d61-86cf-b3b05acc141c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:13 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 Aug 28 20:23:13 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:13 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d 1073741824" returned: 0 in 0.438s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:13 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6" returned: 0 in 0.375s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:13 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6 Aug 28 20:23:13 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:13 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d Aug 28 20:23:13 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:13 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c851b79c-b600-4eb0-a899-0ab5c46c07d6" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Lock "cinder-quobyte-c851b79c-b600-4eb0-a899-0ab5c46c07d6" released by "delete_volume" :: held 0.667s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:13 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504406c7-ff8f-418f-a0c2-65da1cf9ca13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040b73eb-c5dc-400b-b75c-6998f625346d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdfdf18-eab0-4836-b748-057323cd7925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:13 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Volume volume-040b73eb-c5dc-400b-b75c-6998f625346d (040b73eb-c5dc-400b-b75c-6998f625346d): created successfully Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bdfdf18-eab0-4836-b748-057323cd7925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Flow 'volume_create_manager' (28e4aaa6-ecff-422f-a947-28062e0fc32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:23:13 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-52dac96e-807f-4c73-83a7-38680fa62582 tempest-VolumesActionsTest-1778292982 None] Created volume successfully. Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Created reservations ['70d2c378-4bc5-4051-a765-c6435f676023', '82facadd-be6c-4f9a-b019-cca41fb21fbd', '2adbc373-67d1-48f1-9653-cde486443c2f', '22966181-f234-49a9-ba75-e7480e3e5281'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:13 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:23:13 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:14 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.279s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:14 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:23:14 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Deleted volume successfully. Aug 28 20:23:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fce51520-d54a-4dd1-abb9-c2d1b40e5883 tempest-VolumesGetTest-1211406823 None] Lock "cinder-c851b79c-b600-4eb0-a899-0ab5c46c07d6-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:19 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:23:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Flow 'volume_create_manager' (1a5e908a-afc3-4aae-9ae1-994cf87f2bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:23:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392c5356-0576-416a-bbbd-09a17bfc8b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392c5356-0576-416a-bbbd-09a17bfc8b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2128713777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3171b752-cba0-4422-95d5-46c6ae97a5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc6fd94ce944ed1a12ff86f5ae77fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:23:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:23:20Z,use_quota=True,user_id='42f66f7788b848a9b2afa10afd7fb207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a63f748-9647-43ca-b955-80f53ab875ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a63f748-9647-43ca-b955-80f53ab875ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6a76bf-ab6a-4879-9684-935bfa7bf6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6a76bf-ab6a-4879-9684-935bfa7bf6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3171b752-cba0-4422-95d5-46c6ae97a5a7', 'volume_name': 'volume-3171b752-cba0-4422-95d5-46c6ae97a5a7', 'volume_size': 2}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a45bba-e690-4407-a813-4edaa0a70471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a45bba-e690-4407-a813-4edaa0a70471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0b80b5-b7fc-4e1e-8653-cecccfc66ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:20 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Volume 3171b752-cba0-4422-95d5-46c6ae97a5a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3171b752-cba0-4422-95d5-46c6ae97a5a7', 'volume_size': 2} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2128713777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3171b752-cba0-4422-95d5-46c6ae97a5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc6fd94ce944ed1a12ff86f5ae77fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:23:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:23:20Z,use_quota=True,user_id='42f66f7788b848a9b2afa10afd7fb207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Creating volume 3171b752-cba0-4422-95d5-46c6ae97a5a7 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:23:20 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 2147483648 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:20 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 2147483648 Aug 28 20:23:20 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:20 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 2147483648" returned: 0 in 0.578s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:20 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 Aug 28 20:23:20 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:20 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7" returned: 0 in 0.295s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0b80b5-b7fc-4e1e-8653-cecccfc66ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3171b752-cba0-4422-95d5-46c6ae97a5a7', 'volume_size': 2}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:20 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecdb45b7-e94a-43d6-aa87-98a5a442c256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:21 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Volume volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 (3171b752-cba0-4422-95d5-46c6ae97a5a7): created successfully Aug 28 20:23:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecdb45b7-e94a-43d6-aa87-98a5a442c256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Flow 'volume_create_manager' (1a5e908a-afc3-4aae-9ae1-994cf87f2bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:23:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fda7b67b-00df-4063-835b-63b3d64f3a9f tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Created volume successfully. Aug 28 20:23:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5b3df7d0-d8b2-43a7-bea6-27499243a0ff tempest-VolumesActionsTest-1778292982 None] Acquiring lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d" by "attach_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5b3df7d0-d8b2-43a7-bea6-27499243a0ff tempest-VolumesActionsTest-1778292982 None] Lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d" acquired by "attach_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:21 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:INSERT=50,cinder:SELECT=102,cinder:UPDATE=156,cinder:DELETE=11 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:23:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5b3df7d0-d8b2-43a7-bea6-27499243a0ff tempest-VolumesActionsTest-1778292982 None] Attaching volume 040b73eb-c5dc-400b-b75c-6998f625346d to instance 44e31cbb-ea3d-4f65-b938-404b61991bee at mountpoint /dev/vdb on host None. Aug 28 20:23:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5b3df7d0-d8b2-43a7-bea6-27499243a0ff tempest-VolumesActionsTest-1778292982 None] Attach volume completed successfully. Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5b3df7d0-d8b2-43a7-bea6-27499243a0ff tempest-VolumesActionsTest-1778292982 None] Lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d" released by "attach_volume" :: held 0.110s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8df9e764-0e27-403e-886b-cb5d35be9758 tempest-VolumesActionsTest-1778292982 None] Acquiring lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d-detach_volume" by "detach_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Creating offline snapshot 47bd4d5b-2747-4e07-8233-6066f47274d6 of volume 3171b752-cba0-4422-95d5-46c6ae97a5a7 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8df9e764-0e27-403e-886b-cb5d35be9758 tempest-VolumesActionsTest-1778292982 None] Lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8df9e764-0e27-403e-886b-cb5d35be9758 tempest-VolumesActionsTest-1778292982 None] Detaching volume 040b73eb-c5dc-400b-b75c-6998f625346d from instance 44e31cbb-ea3d-4f65-b938-404b61991bee. Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a788a-8382-4ab6-a476-4aa4a7d6866f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8df9e764-0e27-403e-886b-cb5d35be9758 tempest-VolumesActionsTest-1778292982 None] Detach volume completed successfully. Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8df9e764-0e27-403e-886b-cb5d35be9758 tempest-VolumesActionsTest-1778292982 None] Lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:22 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 Aug 28 20:23:22 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:22 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7" returned: 0 in 0.479s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 2G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:22 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 2G Aug 28 20:23:22 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:23 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 2G" returned: 0 in 0.519s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:23 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 Aug 28 20:23:23 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:23 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6" returned: 0 in 0.292s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:23 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 is being set with open permissions: ugo+rw Aug 28 20:23:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:23 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 Aug 28 20:23:23 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:23 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6" returned: 0 in 0.256s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:23 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=124,cinder:UPDATE=142,cinder:INSERT=31,cinder:DELETE=13 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:23:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:23 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.info Aug 28 20:23:23 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:24 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.info" returned: 0 in 0.314s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:24 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.info is being set with open permissions: ugo+rw Aug 28 20:23:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:24 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.info Aug 28 20:23:24 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:24 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.info" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-05bd4a20-d48f-4517-b912-4d7796737945 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Create snapshot completed successfully Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Acquiring lock "cinder-47bd4d5b-2747-4e07-8233-6066f47274d6-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "cinder-47bd4d5b-2747-4e07-8233-6066f47274d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Acquiring lock "cinder-quobyte-3171b752-cba0-4422-95d5-46c6ae97a5a7" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "cinder-quobyte-3171b752-cba0-4422-95d5-46c6ae97a5a7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Acquiring lock "cinder-quobyte-47bd4d5b-2747-4e07-8233-6066f47274d6" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "cinder-quobyte-47bd4d5b-2747-4e07-8233-6066f47274d6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Deleting offline snapshot 47bd4d5b-2747-4e07-8233-6066f47274d6 of volume 3171b752-cba0-4422-95d5-46c6ae97a5a7 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] snapshot_file for this snap is: volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d13abf3-8004-4cbc-b3e9-f76733c2aa3a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:25 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 Aug 28 20:23:25 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:25 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6" returned: 0 in 0.356s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3171b752-cba0-4422-95d5-46c6ae97a5a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ad5cd5-1164-4578-8243-b4167fa8b148]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:26 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 Aug 28 20:23:26 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:26 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:26 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 Aug 28 20:23:26 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:26 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6" returned: 0 in 0.364s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:26 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6 Aug 28 20:23:26 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:26 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7.47bd4d5b-2747-4e07-8233-6066f47274d6" returned: 0 in 0.253s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "cinder-quobyte-47bd4d5b-2747-4e07-8233-6066f47274d6" released by "_delete_snapshot" :: held 1.511s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "cinder-quobyte-3171b752-cba0-4422-95d5-46c6ae97a5a7" released by "delete_snapshot" :: held 1.538s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Created reservations ['c615f38c-f156-4997-914d-ef089b5c4d35', '2ffbf697-c0de-425a-9b82-d2d9a5cc15fd', '1a214765-fa15-47b1-8b67-7b1c2a9182a6', 'd428c9bb-5d80-4fc3-815a-11869d8a016a'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:23:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Delete snapshot completed successfully. Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-97b6f2b0-71f7-4c57-8027-55396da7efe1 tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "cinder-47bd4d5b-2747-4e07-8233-6066f47274d6-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Acquiring lock "cinder-3171b752-cba0-4422-95d5-46c6ae97a5a7-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "cinder-3171b752-cba0-4422-95d5-46c6ae97a5a7-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Acquiring lock "cinder-quobyte-3171b752-cba0-4422-95d5-46c6ae97a5a7" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "cinder-quobyte-3171b752-cba0-4422-95d5-46c6ae97a5a7" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c30d75-aed3-4189-ad31-ab0ee981e662]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:28 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 Aug 28 20:23:28 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:28 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7" returned: 0 in 0.384s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:28 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7 Aug 28 20:23:28 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:28 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3171b752-cba0-4422-95d5-46c6ae97a5a7" returned: 0 in 0.288s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "cinder-quobyte-3171b752-cba0-4422-95d5-46c6ae97a5a7" released by "delete_volume" :: held 0.754s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Created reservations ['305f71b8-781c-4832-9b39-500aad328189', 'f5b2c63e-f344-448c-8fbd-e8c015ed3af0', '6b185f37-e462-498a-ba21-66c66ba9c75b', '025918a6-820e-4ee8-b407-264848b0a6bf'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:23:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:28 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:23:28 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:29 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.329s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:29 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:23:29 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Deleted volume successfully. Aug 28 20:23:29 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8d126e43-5f1e-4598-922d-6dbbbfaf2bca tempest-VolumesSnapshotNegativeTestJSON-1758585725 None] Lock "cinder-3171b752-cba0-4422-95d5-46c6ae97a5a7-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-15aa3317-3701-4bc1-bc03-4f3915530fec tempest-VolumesActionsTest-1778292982 None] Acquiring lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d" by "attach_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-15aa3317-3701-4bc1-bc03-4f3915530fec tempest-VolumesActionsTest-1778292982 None] Lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d" acquired by "attach_volume" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-15aa3317-3701-4bc1-bc03-4f3915530fec tempest-VolumesActionsTest-1778292982 None] Attaching volume 040b73eb-c5dc-400b-b75c-6998f625346d to instance cf218663-3f48-4c57-b0b1-01d0a1c6e5ee at mountpoint /dev/vdb on host None. Aug 28 20:23:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-15aa3317-3701-4bc1-bc03-4f3915530fec tempest-VolumesActionsTest-1778292982 None] Attach volume completed successfully. Aug 28 20:23:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-15aa3317-3701-4bc1-bc03-4f3915530fec tempest-VolumesActionsTest-1778292982 None] Lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d" released by "attach_volume" :: held 0.135s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be2ec7a3-be51-4594-906a-41a42f3297a6 tempest-VolumesActionsTest-1778292982 None] Acquiring lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d-detach_volume" by "detach_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:23:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be2ec7a3-be51-4594-906a-41a42f3297a6 tempest-VolumesActionsTest-1778292982 None] Lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:23:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-be2ec7a3-be51-4594-906a-41a42f3297a6 tempest-VolumesActionsTest-1778292982 None] Detaching volume 040b73eb-c5dc-400b-b75c-6998f625346d from instance cf218663-3f48-4c57-b0b1-01d0a1c6e5ee. Aug 28 20:23:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-be2ec7a3-be51-4594-906a-41a42f3297a6 tempest-VolumesActionsTest-1778292982 None] Detach volume completed successfully. Aug 28 20:23:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be2ec7a3-be51-4594-906a-41a42f3297a6 tempest-VolumesActionsTest-1778292982 None] Lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:23:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:23:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:23:38 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[86057eaa-6de9-4523-887d-e2b0363d0b97]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:38 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d Aug 28 20:23:38 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:38 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d" returned: 0 in 0.373s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:38 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[504622e0-c590-454d-acfc-3230065d0a87]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:38 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d Aug 28 20:23:38 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:39 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d" returned: 0 in 0.388s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.2d4c64b7-92f5-4a2f-9068-116de8e5da97w7opj27r.img {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:39 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.2d4c64b7-92f5-4a2f-9068-116de8e5da97w7opj27r.img Aug 28 20:23:39 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:43 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=6,cinder:UPDATE=19 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:23:43 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.2d4c64b7-92f5-4a2f-9068-116de8e5da97w7opj27r.img" returned: 0 in 4.661s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:43 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1785d6ed-b58e-438c-b3e4-5b52bfc896d6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:23:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:23:43 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d Aug 28 20:23:43 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:23:44 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Aug 28 20:23:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d" returned: 0 in 0.602s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:23:44 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.2d4c64b7-92f5-4a2f-9068-116de8e5da97w7opj27r.img {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:23:44 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Converted 1024.00 MB image at 219.64 MB/s Aug 28 20:23:44 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] 2d4c64b7-92f5-4a2f-9068-116de8e5da97 was raw, no need to convert to raw {{(pid=86028) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 28 20:23:54 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=31,cinder:UPDATE=20,cinder:INSERT=5 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:23:54 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Flow 'volume_create_manager' (a6c06f74-5638-4124-b366-41a7d1e42794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e317ac-d9a9-4123-a075-31bb9c12a3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e317ac-d9a9-4123-a075-31bb9c12a3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1486796831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f808892-957e-454e-ae46-47f32bbba989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='836b7d4936e8409994ab0dc46f7e0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:23:59Z,use_quota=True,user_id='4a923d07aa264684a0cfbc5c75ff7f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5005ad46-e60b-4d82-a97c-98233accb87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5005ad46-e60b-4d82-a97c-98233accb87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01334ee2-90f5-4322-804f-fbe1a9ab4a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01334ee2-90f5-4322-804f-fbe1a9ab4a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f808892-957e-454e-ae46-47f32bbba989', 'volume_name': 'volume-2f808892-957e-454e-ae46-47f32bbba989', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77560fd-8b91-4130-9a1d-30f00b025c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77560fd-8b91-4130-9a1d-30f00b025c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada5658d-9aab-476d-8d30-97aede9fa8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:23:58 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Volume 2f808892-957e-454e-ae46-47f32bbba989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f808892-957e-454e-ae46-47f32bbba989', 'volume_size': 1} Aug 28 20:23:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.438s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Uploaded volume to glance image-id: 2d4c64b7-92f5-4a2f-9068-116de8e5da97. {{(pid=86028) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.141s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1486796831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f808892-957e-454e-ae46-47f32bbba989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='836b7d4936e8409994ab0dc46f7e0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:23:59Z,use_quota=True,user_id='4a923d07aa264684a0cfbc5c75ff7f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Creating volume 2f808892-957e-454e-ae46-47f32bbba989 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:24:06 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:24:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:06 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:24:06 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:06 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 1073741824 Aug 28 20:24:06 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:07 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e6dbdd17-507e-48f7-9386-9aafa10f7747 tempest-VolumesActionsTest-1778292982 None] Copy volume to image completed successfully. Aug 28 20:24:07 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.400s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:24:07 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 1073741824" returned: 0 in 0.553s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:07 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 Aug 28 20:24:07 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:07 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989" returned: 0 in 0.259s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada5658d-9aab-476d-8d30-97aede9fa8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f808892-957e-454e-ae46-47f32bbba989', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aeab8d4-b9fa-434b-b9e5-3b4d73c077e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:07 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Volume volume-2f808892-957e-454e-ae46-47f32bbba989 (2f808892-957e-454e-ae46-47f32bbba989): created successfully Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aeab8d4-b9fa-434b-b9e5-3b4d73c077e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Flow 'volume_create_manager' (a6c06f74-5638-4124-b366-41a7d1e42794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:07 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ac6f2f6d-d5f8-48af-899b-19f4c3695c7f tempest-TestStampPattern-913350203 None] Created volume successfully. Aug 28 20:24:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[966342a8-4aa6-482d-bd46-5ee6bf62cb85]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:09 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d Aug 28 20:24:09 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:09 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d" returned: 0 in 0.381s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:09 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd878add-0135-4e67-a64d-5fb90bb948bb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:09 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d Aug 28 20:24:09 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:09 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d" returned: 0 in 0.361s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:09 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img Aug 28 20:24:09 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:14 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img" returned: 0 in 5.128s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:14 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e901a181-1227-4d10-a0bf-b96b1bf04d93]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:14 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d Aug 28 20:24:14 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:15 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d" returned: 0 in 0.527s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:15 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:24:15 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Converted 1024.00 MB image at 199.64 MB/s Aug 28 20:24:15 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] 3d91a816-95b9-41cf-9ad8-8f943631ee71 was raw, converting to qcow2 {{(pid=86028) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 28 20:24:15 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[75404d68-fdb7-4fa9-93e1-9ecf484493cf]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:15 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img Aug 28 20:24:15 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:15 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img" returned: 0 in 0.318s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:15 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img Aug 28 20:24:15 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:16 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img" returned: 1 in 0.311s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:24:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img /opt/stack/data/cinder/conversion/vol_upload_varyud70 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:16 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img /opt/stack/data/cinder/conversion/vol_upload_varyud70 Aug 28 20:24:16 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:16 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img /opt/stack/data/cinder/conversion/vol_upload_varyud70" returned: 0 in 0.269s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:16 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Image conversion details: src /opt/stack/data/cinder/conversion/040b73eb-c5dc-400b-b75c-6998f625346d.temp_image.3d91a816-95b9-41cf-9ad8-8f943631ee71fz2a2je3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_varyud70 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:24:16 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 28 20:24:16 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91877d3-9607-4572-9548-31c6754a02d9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_varyud70 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:16 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_varyud70 Aug 28 20:24:16 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:16 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_varyud70" returned: 0 in 0.335s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.051s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:17 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Uploaded volume to glance image-id: 3d91a816-95b9-41cf-9ad8-8f943631ee71. {{(pid=86028) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 28 20:24:18 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-618d9743-6fe6-43ac-9405-6e2ea3d52ff7 tempest-VolumesActionsTest-1778292982 None] Copy volume to image completed successfully. Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Acquiring lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Acquiring lock "cinder-quobyte-040b73eb-c5dc-400b-b75c-6998f625346d" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Lock "cinder-quobyte-040b73eb-c5dc-400b-b75c-6998f625346d" acquired by "delete_volume" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[053e914e-d467-47ee-baca-1480478e8e8f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:19 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d Aug 28 20:24:19 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:19 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d" returned: 0 in 0.359s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:19 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d Aug 28 20:24:19 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:19 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-040b73eb-c5dc-400b-b75c-6998f625346d" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Lock "cinder-quobyte-040b73eb-c5dc-400b-b75c-6998f625346d" released by "delete_volume" :: held 0.632s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Created reservations ['23a3b14a-898e-4ac6-82e4-73654cee7314', '73f8a6c7-7d6e-4f40-9da6-f551e95b30cf', 'be4b70d6-ef47-4168-871f-9f5efbf00311', '1335d6b8-3fa1-4726-a215-11e32628772a'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:19 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:24:19 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:20 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.249s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:20 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:24:20 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Deleted volume successfully. Aug 28 20:24:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f60795fb-12a5-407e-8d28-2a155317f587 tempest-VolumesActionsTest-1778292982 None] Lock "cinder-040b73eb-c5dc-400b-b75c-6998f625346d-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Flow 'volume_create_manager' (519c0426-b4d1-4ea4-a3b1-a7a1b162d085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913489d8-6647-4650-aebc-716f0d65f67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913489d8-6647-4650-aebc-716f0d65f67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-632923801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5faa2477cd5a41e8be2e9af1afb54951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:24:26Z,use_quota=True,user_id='ec3e957adcfe41ccbd457587b8ebd49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1603b60-7726-4c21-9bf9-5670d61edc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1603b60-7726-4c21-9bf9-5670d61edc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335ed774-c619-470d-ada6-0f37d681c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335ed774-c619-470d-ada6-0f37d681c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf', 'volume_name': 'volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd43730f-c0ef-419b-a965-d869b1eb7149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd43730f-c0ef-419b-a965-d869b1eb7149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6e5c39-e3fc-47c9-887d-7fdb98f4d78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:26 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Volume 44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf', 'volume_size': 1} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-632923801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5faa2477cd5a41e8be2e9af1afb54951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:24:26Z,use_quota=True,user_id='ec3e957adcfe41ccbd457587b8ebd49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Creating volume 44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:24:26 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:26 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf 1073741824 Aug 28 20:24:26 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:26 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf 1073741824" returned: 0 in 0.417s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:27 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf Aug 28 20:24:27 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:27 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf" returned: 0 in 0.236s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6e5c39-e3fc-47c9-887d-7fdb98f4d78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f384160f-e836-494c-831a-fd2213e113da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:27 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Volume volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf (44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf): created successfully Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f384160f-e836-494c-831a-fd2213e113da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Flow 'volume_create_manager' (519c0426-b4d1-4ea4-a3b1-a7a1b162d085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1df1937d-938f-431b-8028-18d0d047271e tempest-VolumesCloneTest-197492607 None] Created volume successfully. Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Flow 'volume_create_manager' (137ce05c-4c66-48f0-8a80-d4c76f076191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0b597c-9f36-44f6-8f97-256350c475b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0b597c-9f36-44f6-8f97-256350c475b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1065506909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b5df51-fa17-42f0-a92d-aa5f28bc9c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5faa2477cd5a41e8be2e9af1afb54951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:24:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf,status='creating',terminated_at=None,updated_at=2026-08-28T18:24:28Z,use_quota=True,user_id='ec3e957adcfe41ccbd457587b8ebd49d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76582df-1d57-4062-bec9-4c1cf509699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76582df-1d57-4062-bec9-4c1cf509699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75373f80-301f-4af6-a3fc-44a946ffbadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75373f80-301f-4af6-a3fc-44a946ffbadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '95b5df51-fa17-42f0-a92d-aa5f28bc9c30', 'volume_name': 'volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30', 'volume_size': 2, 'source_volid': '44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf', 'source_volstatus': 'available'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317e3074-6f94-41fe-aa5b-ae7dc4dbafcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317e3074-6f94-41fe-aa5b-ae7dc4dbafcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68878b46-fe5b-4a2d-ae32-85844d7f6801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:28 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Volume 95b5df51-fa17-42f0-a92d-aa5f28bc9c30: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30', 'volume_size': 2, 'source_volid': '44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf', 'source_volstatus': 'available'} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:28 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Cloning volume 44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf to volume 95b5df51-fa17-42f0-a92d-aa5f28bc9c30 Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Creating offline snapshot 06d05f62-cc7c-4960-b09d-b47dc5b88ebd of volume 44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b1d28b-4dae-44e9-8ba3-034fa4f87b7d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:28 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf Aug 28 20:24:28 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:28 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf" returned: 0 in 0.382s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:28 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd 1G Aug 28 20:24:28 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:28 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd 1G" returned: 0 in 0.450s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:28 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd Aug 28 20:24:28 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:29 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd" returned: 0 in 0.311s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:29 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd is being set with open permissions: ugo+rw Aug 28 20:24:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:29 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd Aug 28 20:24:29 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:29 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:29 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.info Aug 28 20:24:29 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-9a1baada-57a5-4aa1-88c3-499aeb230305 req-599fe147-a1be-45d6-bb36-84f65fa45e1f tempest-TestStampPattern-913350203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:29 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.info" returned: 0 in 0.264s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:29 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.info is being set with open permissions: ugo+rw Aug 28 20:24:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:29 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.info Aug 28 20:24:29 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:30 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.info" returned: 0 in 0.246s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Acquiring lock "cinder-quobyte-95b5df51-fa17-42f0-a92d-aa5f28bc9c30" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Lock "cinder-quobyte-95b5df51-fa17-42f0-a92d-aa5f28bc9c30" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] snapshot: 06d05f62-cc7c-4960-b09d-b47dc5b88ebd, volume: 95b5df51-fa17-42f0-a92d-aa5f28bc9c30, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1e7984-0cb3-4082-bf9f-e3861a67ee7d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:30 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd Aug 28 20:24:30 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:30 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd" returned: 0 in 0.354s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df6285d-8e2d-4992-9fb4-955c2b9d8b2f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:30 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf Aug 28 20:24:30 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:30 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf" returned: 0 in 0.339s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:24:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:30 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 Aug 28 20:24:30 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:34 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30" returned: 0 in 4.152s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:34 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:24:34 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Converted 1024.00 MB image at 246.55 MB/s Aug 28 20:24:34 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 is being set with open permissions: ugo+rw Aug 28 20:24:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:34 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 Aug 28 20:24:34 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:35 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30" returned: 0 in 0.241s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Lock "cinder-quobyte-95b5df51-fa17-42f0-a92d-aa5f28bc9c30" released by "_copy_volume_from_snapshot" :: held 5.149s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Acquiring lock "cinder-quobyte-06d05f62-cc7c-4960-b09d-b47dc5b88ebd" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Lock "cinder-quobyte-06d05f62-cc7c-4960-b09d-b47dc5b88ebd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Deleting offline snapshot 06d05f62-cc7c-4960-b09d-b47dc5b88ebd of volume 44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] snapshot_file for this snap is: volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a764637d-e55e-46d8-84af-c1209dcbec9d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:35 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd Aug 28 20:24:35 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:35 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd" returned: 0 in 0.348s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0ff93c-b1bb-4e00-a6bd-8fff7f3e0de2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:35 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf Aug 28 20:24:35 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:36 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf" returned: 0 in 0.527s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:36 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd Aug 28 20:24:36 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:36 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd" returned: 0 in 0.324s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:36 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd Aug 28 20:24:36 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:36 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf.06d05f62-cc7c-4960-b09d-b47dc5b88ebd" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Lock "cinder-quobyte-06d05f62-cc7c-4960-b09d-b47dc5b88ebd" released by "_delete_snapshot" :: held 1.517s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.743s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-9a1baada-57a5-4aa1-88c3-499aeb230305 req-599fe147-a1be-45d6-bb36-84f65fa45e1f tempest-TestStampPattern-913350203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.162s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-9a1baada-57a5-4aa1-88c3-499aeb230305 req-599fe147-a1be-45d6-bb36-84f65fa45e1f tempest-TestStampPattern-913350203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68878b46-fe5b-4a2d-ae32-85844d7f6801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30', 'volume_size': 2, 'source_volid': '44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf', 'source_volstatus': 'available'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf688a48-df28-4fba-8e43-436a314c71e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Volume volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 (95b5df51-fa17-42f0-a92d-aa5f28bc9c30): created successfully Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf688a48-df28-4fba-8e43-436a314c71e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Flow 'volume_create_manager' (137ce05c-4c66-48f0-8a80-d4c76f076191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-9a1baada-57a5-4aa1-88c3-499aeb230305 req-599fe147-a1be-45d6-bb36-84f65fa45e1f tempest-TestStampPattern-913350203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-2f808892-957e-454e-ae46-47f32bbba989', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92a0b685-1164-4f21-8339-98d472148a8f', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:24:36 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9a3b1013-b923-46b2-9960-73b3f68c73ac tempest-VolumesCloneTest-197492607 None] Created volume successfully. Aug 28 20:24:36 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-9a1baada-57a5-4aa1-88c3-499aeb230305 req-599fe147-a1be-45d6-bb36-84f65fa45e1f tempest-TestStampPattern-913350203 None] attachment_update completed successfully. Aug 28 20:24:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Acquiring lock "cinder-95b5df51-fa17-42f0-a92d-aa5f28bc9c30-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Lock "cinder-95b5df51-fa17-42f0-a92d-aa5f28bc9c30-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Acquiring lock "cinder-quobyte-95b5df51-fa17-42f0-a92d-aa5f28bc9c30" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Lock "cinder-quobyte-95b5df51-fa17-42f0-a92d-aa5f28bc9c30" acquired by "delete_volume" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:37 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f4f59f-1a9b-4bdf-8611-50d34143c026]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:37 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 Aug 28 20:24:37 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:38 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30" returned: 0 in 0.361s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:38 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30 Aug 28 20:24:38 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:38 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-95b5df51-fa17-42f0-a92d-aa5f28bc9c30" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Lock "cinder-quobyte-95b5df51-fa17-42f0-a92d-aa5f28bc9c30" released by "delete_volume" :: held 0.652s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Created reservations ['31ff02d3-ed90-4720-88aa-77924ba4ca59', '29966234-a0bb-4dee-90bc-f567fd373f51', '57f55f43-4024-46a1-adcb-549abc9e8018', '2287cd5d-d5d5-4244-8018-8c491f016511'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:38 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:24:38 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:38 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:24:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Deleted volume successfully. Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-48b4d1a9-f1cf-4973-a096-7f9337720598 tempest-VolumesCloneTest-197492607 None] Lock "cinder-95b5df51-fa17-42f0-a92d-aa5f28bc9c30-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Acquiring lock "cinder-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Lock "cinder-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Acquiring lock "cinder-quobyte-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Lock "cinder-quobyte-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bab8f3-3bbf-450c-af9a-a90386567f78]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:39 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf Aug 28 20:24:39 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:39 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf" returned: 0 in 0.366s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:39 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf Aug 28 20:24:39 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:39 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf" returned: 0 in 0.258s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Lock "cinder-quobyte-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf" released by "delete_volume" :: held 0.684s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Created reservations ['d9372ec2-6fff-4689-817c-299f853012a4', '29ed75f3-3ffe-452c-b099-5736dadd5a0a', '0d387538-b2a8-453e-ab9d-3c49903b565c', '1a6ba14a-990d-43dd-a41d-e936bf0887d8'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:39 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:24:39 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:40 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.275s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:40 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:24:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Deleted volume successfully. Aug 28 20:24:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0a2ce566-2eea-4fd5-a1ab-cce2ff6b0357 tempest-VolumesCloneTest-197492607 None] Lock "cinder-44b2d6ce-69bd-44ed-bac9-73d6fbcf39cf-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-e9e871c6-f74d-4cb8-a5c0-ae3e8d1f9485 req-1e3f7a09-e6c9-4895-8e8b-d722b8bbff2f tempest-TestStampPattern-913350203 None] Terminate volume connection completed successfully. Aug 28 20:24:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-e9e871c6-f74d-4cb8-a5c0-ae3e8d1f9485 req-1e3f7a09-e6c9-4895-8e8b-d722b8bbff2f tempest-TestStampPattern-913350203 None] Deleting attachment 92a0b685-1164-4f21-8339-98d472148a8f. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:24:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Creating offline snapshot b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a of volume 2f808892-957e-454e-ae46-47f32bbba989 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:24:42 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a2c1f5-9cc5-44f7-a710-8112326145bf]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:42 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 Aug 28 20:24:42 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:42 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989" returned: 0 in 0.376s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:42 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a 1G Aug 28 20:24:42 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:43 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a 1G" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f808892-957e-454e-ae46-47f32bbba989 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:43 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f808892-957e-454e-ae46-47f32bbba989 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a Aug 28 20:24:43 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:43 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f808892-957e-454e-ae46-47f32bbba989 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a" returned: 0 in 0.322s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:43 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a is being set with open permissions: ugo+rw Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:43 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a Aug 28 20:24:43 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Flow 'volume_create_manager' (9891b4e7-a697-47e4-814a-b7fd19c87a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8908a418-04dc-45c5-ab4e-e07135774b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8908a418-04dc-45c5-ab4e-e07135774b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1817734990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cad2b5-2ff4-4b51-b743-703a9f2aa7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3070a25f87c4e6baa9c99d8ea9d87d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:24:43Z,use_quota=True,user_id='01dbecaa9bba49d6a05a2e846bbe36a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02569782-d960-4017-94bb-8b78dbdd52cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02569782-d960-4017-94bb-8b78dbdd52cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736b2a4d-d80e-4d57-ac27-3d3d0c19d8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.image.glance [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Creating Keystone auth plugin from conf {{(pid=86028) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 20:24:43 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:43 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.info Aug 28 20:24:43 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736b2a4d-d80e-4d57-ac27-3d3d0c19d8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a4cad2b5-2ff4-4b51-b743-703a9f2aa7df', 'volume_name': 'volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c386f6-f3c9-4d0e-b9de-9018a4450488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c386f6-f3c9-4d0e-b9de-9018a4450488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339542ed-0326-4229-921e-ec275713d4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:43 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Volume a4cad2b5-2ff4-4b51-b743-703a9f2aa7df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Trying to clone a4cad2b5-2ff4-4b51-b743-703a9f2aa7df from image b69357c8-f1c6-42fd-802c-792fbb69d92d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]). {{(pid=86028) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 20:24:43 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.info" returned: 0 in 0.270s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:43 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.info is being set with open permissions: ugo+rw Aug 28 20:24:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:44 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.info Aug 28 20:24:44 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 20:24:44 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Image download 20.69 MB at 20.69 MB/s Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b822f218-57a7-4a8d-9ea4-034d9de0bb43]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:44 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.info" returned: 0 in 0.279s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:44 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e332ec24-5998-4a0a-89d4-5503479a572d tempest-TestStampPattern-913350203 None] Create snapshot completed successfully Aug 28 20:24:44 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD Aug 28 20:24:44 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:44 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Temporary image b69357c8-f1c6-42fd-802c-792fbb69d92d is fetched for user 01dbecaa9bba49d6a05a2e846bbe36a0. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9745f146-c0e6-4d3f-8b6c-dd8134c3b378]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:44 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD Aug 28 20:24:44 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:44 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1817734990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4cad2b5-2ff4-4b51-b743-703a9f2aa7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3070a25f87c4e6baa9c99d8ea9d87d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:24:43Z,use_quota=True,user_id='01dbecaa9bba49d6a05a2e846bbe36a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Creating volume a4cad2b5-2ff4-4b51-b743-703a9f2aa7df {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:24:44 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:24:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:45 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df 1073741824 Aug 28 20:24:45 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:45 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df 1073741824" returned: 0 in 0.482s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:45 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df Aug 28 20:24:45 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:45 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df" returned: 0 in 0.258s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:24:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:45 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Attempting download of b69357c8-f1c6-42fd-802c-792fbb69d92d ((None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}])) to volume a4cad2b5-2ff4-4b51-b743-703a9f2aa7df. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 20:24:45 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[24feaeec-1a59-40d8-ba95-21122357b493]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_46vbihqz {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:45 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_46vbihqz Aug 28 20:24:45 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:46 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_46vbihqz" returned: 0 in 0.344s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_46vbihqz {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:46 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_46vbihqz Aug 28 20:24:46 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:46 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_46vbihqz" returned: 1 in 0.351s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_46vbihqz' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:24:46 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7177e5e1-33ea-47e6-a6c8-0e84de30e1c6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:46 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD Aug 28 20:24:46 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:46 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:46 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] b69357c8-f1c6-42fd-802c-792fbb69d92d was qcow2, converting to qcow2 {{(pid=86028) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 20:24:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:46 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df Aug 28 20:24:46 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:48 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df" returned: 0 in 1.886s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:48 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_vx28purxdevstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:24:48 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Converted 112.00 MB image at 59.36 MB/s Aug 28 20:24:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:48 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df 1G Aug 28 20:24:48 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:49 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df 1G" returned: 0 in 0.335s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Downloaded image b69357c8-f1c6-42fd-802c-792fbb69d92d ((None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}])) to volume a4cad2b5-2ff4-4b51-b743-703a9f2aa7df successfully. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Temporary image b69357c8-f1c6-42fd-802c-792fbb69d92d for user 01dbecaa9bba49d6a05a2e846bbe36a0 is deleted. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Marking volume a4cad2b5-2ff4-4b51-b743-703a9f2aa7df as bootable. {{(pid=86028) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Copying metadata from image b69357c8-f1c6-42fd-802c-792fbb69d92d to a4cad2b5-2ff4-4b51-b743-703a9f2aa7df. {{(pid=86028) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Creating volume glance metadata for volume a4cad2b5-2ff4-4b51-b743-703a9f2aa7df backed by image b69357c8-f1c6-42fd-802c-792fbb69d92d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86028) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339542ed-0326-4229-921e-ec275713d4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62bcfbde-1e94-43c6-8b30-f70a9f8a55ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:49 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Volume volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df (a4cad2b5-2ff4-4b51-b743-703a9f2aa7df): created successfully Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62bcfbde-1e94-43c6-8b30-f70a9f8a55ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Flow 'volume_create_manager' (9891b4e7-a697-47e4-814a-b7fd19c87a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7b8956b2-1d3d-48b6-837c-b1b32ee38c77 tempest-VolumesExtendTest-1806916240 None] Created volume successfully. Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b59a4fa5-a921-49bc-bd07-cec6cd2aecdc tempest-VolumesExtendTest-1806916240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b59a4fa5-a921-49bc-bd07-cec6cd2aecdc tempest-VolumesExtendTest-1806916240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3be84e5-bdb7-4a52-9dd5-b3b757711f70]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b59a4fa5-a921-49bc-bd07-cec6cd2aecdc tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:50 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df Aug 28 20:24:50 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:50 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b59a4fa5-a921-49bc-bd07-cec6cd2aecdc tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df" returned: 0 in 0.366s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b59a4fa5-a921-49bc-bd07-cec6cd2aecdc tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df 2G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b59a4fa5-a921-49bc-bd07-cec6cd2aecdc tempest-VolumesExtendTest-1806916240 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df 2G" returned: 0 in 0.082s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b59a4fa5-a921-49bc-bd07-cec6cd2aecdc tempest-VolumesExtendTest-1806916240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.471s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b59a4fa5-a921-49bc-bd07-cec6cd2aecdc tempest-VolumesExtendTest-1806916240 None] Extend volume completed successfully. Aug 28 20:24:50 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Flow 'volume_create_manager' (461a0765-5d57-49ac-a987-8afba5b1687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41aac61-20c5-400e-9add-1ac9e95a0159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41aac61-20c5-400e-9add-1ac9e95a0159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-453931121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='836b7d4936e8409994ab0dc46f7e0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:24:51Z,use_quota=True,user_id='4a923d07aa264684a0cfbc5c75ff7f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7671c795-5ea1-4b6c-8956-d0030251ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7671c795-5ea1-4b6c-8956-d0030251ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f04106-df5f-403b-9add-8c576998df55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f04106-df5f-403b-9add-8c576998df55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c', 'volume_name': 'volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c', 'volume_size': 1, 'snapshot_id': 'b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8c633a-5de1-4c0f-8284-099689bfeb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8c633a-5de1-4c0f-8284-099689bfeb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e340233-68f6-4a38-b0c6-c6ec73532431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:51 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Volume ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c', 'volume_size': 1, 'snapshot_id': 'b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a'} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Acquiring lock "cinder-quobyte-b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" by "_create_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Creating volume ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c from snapshot b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a {{(pid=86028) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Acquiring lock "cinder-quobyte-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] snapshot: b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a, volume: ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "cinder-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[988a2a09-4352-4752-ad3e-a6419db4919e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "cinder-quobyte-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-quobyte-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[95aea49a-ff1a-41cd-8ce5-4aea756b53c1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:51 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a Aug 28 20:24:51 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:51 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df Aug 28 20:24:51 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:51 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a" returned: 0 in 0.429s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f808892-957e-454e-ae46-47f32bbba989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b9f260-8052-40b1-9725-0f5c218aea6a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:51 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df" returned: 0 in 0.398s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:51 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df Aug 28 20:24:51 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:51 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 Aug 28 20:24:51 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:52 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df" returned: 0 in 0.315s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-quobyte-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df" released by "delete_volume" :: held 0.759s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:52 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989" returned: 0 in 0.449s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Created reservations ['cc1bb5d5-d9cf-4426-9d9c-de6a817688cb', '2a0fd98b-c732-4a85-a7df-4d7259385cf9', '1398dc3a-f31a-40d6-b4b1-5a20d317c855', '4604599b-a858-427e-adb4-5eeb58715715'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:24:52 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c Aug 28 20:24:52 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:52 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:24:52 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:52 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.327s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:24:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Deleted volume successfully. Aug 28 20:24:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f4ec40b7-b448-466d-a24d-7164686a2123 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-a4cad2b5-2ff4-4b51-b743-703a9f2aa7df-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Flow 'volume_create_manager' (2c732b52-7482-4136-9d72-c9cb506efcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e49057-f4ff-49ba-8db6-ff2e605e9af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e49057-f4ff-49ba-8db6-ff2e605e9af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1154652065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ea7625-57b6-4879-9ece-5082010d4519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3070a25f87c4e6baa9c99d8ea9d87d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:24:53Z,use_quota=True,user_id='01dbecaa9bba49d6a05a2e846bbe36a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeae917-2620-484c-9ef6-ea96db8c6797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeae917-2620-484c-9ef6-ea96db8c6797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568dfed9-c6a9-4b9b-94e3-730ee46c2245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568dfed9-c6a9-4b9b-94e3-730ee46c2245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ea7625-57b6-4879-9ece-5082010d4519', 'volume_name': 'volume-b7ea7625-57b6-4879-9ece-5082010d4519', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb3fe1b-3d39-4f3b-91ff-007a9c97300c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb3fe1b-3d39-4f3b-91ff-007a9c97300c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245e5651-b19a-4211-b14e-10b48f6c5bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:53 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Volume b7ea7625-57b6-4879-9ece-5082010d4519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ea7625-57b6-4879-9ece-5082010d4519', 'volume_size': 1} Aug 28 20:24:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:58 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" returned: 0 in 6.144s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:24:58 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Converted 1024.00 MB image at 166.66 MB/s Aug 28 20:24:58 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c is being set with open permissions: ugo+rw Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:58 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c Aug 28 20:24:58 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:58 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" returned: 0 in 0.277s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" released by "_copy_volume_from_snapshot" :: held 7.404s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=65,cinder:UPDATE=51,cinder:DELETE=4,cinder:INSERT=17 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=59,cinder:SELECT=49,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" released by "_create_volume_from_snapshot" :: held 7.483s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.508s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.338s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1154652065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ea7625-57b6-4879-9ece-5082010d4519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3070a25f87c4e6baa9c99d8ea9d87d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:24:53Z,use_quota=True,user_id='01dbecaa9bba49d6a05a2e846bbe36a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Creating volume b7ea7625-57b6-4879-9ece-5082010d4519 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:24:58 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:58 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 1073741824 Aug 28 20:24:58 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e340233-68f6-4a38-b0c6-c6ec73532431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c', 'volume_size': 1, 'snapshot_id': 'b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dca4e7e-56ab-4157-967e-539d7078625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:58 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Volume volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c (ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c): created successfully Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dca4e7e-56ab-4157-967e-539d7078625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:58 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Flow 'volume_create_manager' (461a0765-5d57-49ac-a987-8afba5b1687a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:58 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4e84e432-6a08-486d-a88e-ff21c5656529 tempest-TestStampPattern-913350203 None] Created volume successfully. Aug 28 20:24:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 1073741824" returned: 0 in 0.532s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:59 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:24:59 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 Aug 28 20:24:59 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:24:59 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Aug 28 20:24:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519" returned: 0 in 0.417s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:24:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:24:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:24:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245e5651-b19a-4211-b14e-10b48f6c5bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ea7625-57b6-4879-9ece-5082010d4519', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07605c8-c26f-4dcb-a99f-edbe91df7587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:24:59 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Volume volume-b7ea7625-57b6-4879-9ece-5082010d4519 (b7ea7625-57b6-4879-9ece-5082010d4519): created successfully Aug 28 20:24:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07605c8-c26f-4dcb-a99f-edbe91df7587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:24:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Flow 'volume_create_manager' (2c732b52-7482-4136-9d72-c9cb506efcf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:24:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9837c82b-e47a-4bf5-8d37-a73c406942d0 tempest-VolumesExtendTest-1806916240 None] Created volume successfully. Aug 28 20:25:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Creating offline snapshot f8188bff-0463-4c50-901d-8d8da3bb19f8 of volume b7ea7625-57b6-4879-9ece-5082010d4519 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:25:00 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b3a899-6ab5-4f7b-8995-2144e6e3a86c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:25:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:00 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 Aug 28 20:25:00 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:00 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519" returned: 0 in 0.354s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:00 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 1G Aug 28 20:25:00 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:01 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 1G" returned: 0 in 0.456s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7ea7625-57b6-4879-9ece-5082010d4519 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:01 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7ea7625-57b6-4879-9ece-5082010d4519 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 Aug 28 20:25:01 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:01 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7ea7625-57b6-4879-9ece-5082010d4519 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8" returned: 0 in 0.305s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:01 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 is being set with open permissions: ugo+rw Aug 28 20:25:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:01 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 Aug 28 20:25:01 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:01 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8" returned: 0 in 0.273s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:01 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.info Aug 28 20:25:01 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:02 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.info" returned: 0 in 0.293s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:02 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.info is being set with open permissions: ugo+rw Aug 28 20:25:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:02 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.info Aug 28 20:25:02 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:02 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.info" returned: 0 in 0.291s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-916a734e-9178-4103-bdad-87cc2c743134 tempest-VolumesExtendTest-1806916240 None] Create snapshot completed successfully Aug 28 20:25:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9e031fad-094f-4c12-bcb3-bb74a088210b tempest-VolumesExtendTest-1806916240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9e031fad-094f-4c12-bcb3-bb74a088210b tempest-VolumesExtendTest-1806916240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:03 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e106ae0-659f-41e4-a8c6-7d6374941697]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:25:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9e031fad-094f-4c12-bcb3-bb74a088210b tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:03 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 Aug 28 20:25:03 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:04 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9e031fad-094f-4c12-bcb3-bb74a088210b tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519" returned: 0 in 0.468s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9e031fad-094f-4c12-bcb3-bb74a088210b tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 2G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9e031fad-094f-4c12-bcb3-bb74a088210b tempest-VolumesExtendTest-1806916240 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 2G" returned: 0 in 0.140s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9e031fad-094f-4c12-bcb3-bb74a088210b tempest-VolumesExtendTest-1806916240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.664s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:04 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9e031fad-094f-4c12-bcb3-bb74a088210b tempest-VolumesExtendTest-1806916240 None] Extend volume completed successfully. Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "cinder-f8188bff-0463-4c50-901d-8d8da3bb19f8-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-f8188bff-0463-4c50-901d-8d8da3bb19f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "cinder-quobyte-b7ea7625-57b6-4879-9ece-5082010d4519" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-quobyte-b7ea7625-57b6-4879-9ece-5082010d4519" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "cinder-quobyte-f8188bff-0463-4c50-901d-8d8da3bb19f8" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-quobyte-f8188bff-0463-4c50-901d-8d8da3bb19f8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Deleting offline snapshot f8188bff-0463-4c50-901d-8d8da3bb19f8 of volume b7ea7625-57b6-4879-9ece-5082010d4519 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] snapshot_file for this snap is: volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[232c0ad6-f04d-46f3-a2a4-8dfb7af37ffc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:25:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:04 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 Aug 28 20:25:04 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:05 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8" returned: 0 in 0.365s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7ea7625-57b6-4879-9ece-5082010d4519(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:25:05 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[331e812a-1e61-4162-a72d-6cdee5af6850]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:25:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:05 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 Aug 28 20:25:05 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:05 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519" returned: 0 in 0.349s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:05 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 Aug 28 20:25:05 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:05 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8" returned: 0 in 0.379s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:06 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8 Aug 28 20:25:06 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:06 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519.f8188bff-0463-4c50-901d-8d8da3bb19f8" returned: 0 in 0.264s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-quobyte-f8188bff-0463-4c50-901d-8d8da3bb19f8" released by "_delete_snapshot" :: held 1.457s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-quobyte-b7ea7625-57b6-4879-9ece-5082010d4519" released by "delete_snapshot" :: held 1.479s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Created reservations ['d4524345-da91-412c-b89e-ab7ddb5fee3c', '320a330e-1938-4508-aac6-7cc22312b8fe', '492d4f4e-510e-4ea3-b8c0-482fe17437ec', '97250888-6add-44ef-9195-b43b76855df4'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:25:06 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Delete snapshot completed successfully. Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f3e9a26b-8c98-4f16-b898-3bc5b5dd88a8 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-f8188bff-0463-4c50-901d-8d8da3bb19f8-delete_snapshot" released by "delete_snapshot" :: held 1.608s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:06 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:25:06 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "cinder-b7ea7625-57b6-4879-9ece-5082010d4519-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-b7ea7625-57b6-4879-9ece-5082010d4519-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "cinder-quobyte-b7ea7625-57b6-4879-9ece-5082010d4519" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:07 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.267s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-quobyte-b7ea7625-57b6-4879-9ece-5082010d4519" acquired by "delete_volume" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9897fb5-3bf7-4b51-b80d-be31e43017c8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:07 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 Aug 28 20:25:07 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:07 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519" returned: 0 in 0.363s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:07 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519 Aug 28 20:25:07 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:07 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b7ea7625-57b6-4879-9ece-5082010d4519" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-quobyte-b7ea7625-57b6-4879-9ece-5082010d4519" released by "delete_volume" :: held 0.675s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Created reservations ['4b88f853-b9c3-446c-8903-dae8c231f707', '9ce67443-c158-4aff-9cb3-57fe894a624b', 'f88faf6a-40c6-4403-83c8-dd4f74de9d5b', '5ac96957-ccfa-4eed-979e-9f421623918f'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:07 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:25:07 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:08 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.265s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:08 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:25:08 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Deleted volume successfully. Aug 28 20:25:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69b07e77-3581-4f08-bf2f-066f110ae208 tempest-VolumesExtendTest-1806916240 None] Lock "cinder-b7ea7625-57b6-4879-9ece-5082010d4519-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Flow 'volume_create_manager' (aee27429-4fff-4426-a39b-7400ea7a9dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0399fc7-d690-4dee-a097-a3bcdd9b947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0399fc7-d690-4dee-a097-a3bcdd9b947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-353772640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f831c2b0-75a9-4d6c-87ef-851c121e7077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98feb6fd87ba496faaa00f724af2d06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:25:11Z,use_quota=True,user_id='fd023a7714b14a02909d77259bd01c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480e25c7-773c-4930-9a2d-7cf85e0998a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480e25c7-773c-4930-9a2d-7cf85e0998a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853788be-bcbf-4034-833e-902e2fb3baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853788be-bcbf-4034-833e-902e2fb3baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f831c2b0-75a9-4d6c-87ef-851c121e7077', 'volume_name': 'volume-f831c2b0-75a9-4d6c-87ef-851c121e7077', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6d74e1-7ef0-49e3-902f-b3ee8a4efc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6d74e1-7ef0-49e3-902f-b3ee8a4efc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77de72d5-ce3d-453f-80f0-2fe99ff80ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:11 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Volume f831c2b0-75a9-4d6c-87ef-851c121e7077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f831c2b0-75a9-4d6c-87ef-851c121e7077', 'volume_size': 1} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-353772640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f831c2b0-75a9-4d6c-87ef-851c121e7077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98feb6fd87ba496faaa00f724af2d06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:25:11Z,use_quota=True,user_id='fd023a7714b14a02909d77259bd01c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Creating volume f831c2b0-75a9-4d6c-87ef-851c121e7077 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:25:11 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:11 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077 1073741824 Aug 28 20:25:11 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:11 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077 1073741824" returned: 0 in 0.421s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:11 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077 Aug 28 20:25:11 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:11 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077" returned: 0 in 0.257s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77de72d5-ce3d-453f-80f0-2fe99ff80ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f831c2b0-75a9-4d6c-87ef-851c121e7077', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24a5cfa-ca5f-4980-9ff8-b0dbd928099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:11 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Volume volume-f831c2b0-75a9-4d6c-87ef-851c121e7077 (f831c2b0-75a9-4d6c-87ef-851c121e7077): created successfully Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24a5cfa-ca5f-4980-9ff8-b0dbd928099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:11 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Flow 'volume_create_manager' (aee27429-4fff-4426-a39b-7400ea7a9dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:25:11 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9960cc40-e728-4e53-9aca-a1551b7dd006 tempest-VolumesNegativeTest-395853307 None] Created volume successfully. Aug 28 20:25:21 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=20,cinder:INSERT=4,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:25:21 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=19,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Acquiring lock "cinder-f831c2b0-75a9-4d6c-87ef-851c121e7077-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Lock "cinder-f831c2b0-75a9-4d6c-87ef-851c121e7077-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Acquiring lock "cinder-quobyte-f831c2b0-75a9-4d6c-87ef-851c121e7077" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Lock "cinder-quobyte-f831c2b0-75a9-4d6c-87ef-851c121e7077" acquired by "delete_volume" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e330a410-e2c2-44c6-b221-46a5a5af6d8d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:27 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077 Aug 28 20:25:27 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:27 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077" returned: 0 in 0.342s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:27 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077 Aug 28 20:25:27 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:27 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f831c2b0-75a9-4d6c-87ef-851c121e7077" returned: 0 in 0.238s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Lock "cinder-quobyte-f831c2b0-75a9-4d6c-87ef-851c121e7077" released by "delete_volume" :: held 0.615s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Created reservations ['655ad806-e2df-474d-8ad5-966235b05d17', 'cd701daf-3fe3-4042-969e-aeb75c7ce253', '64dfc42e-62a8-48a5-8254-a4b443c971f4', '7e13596e-1d2a-4727-95e8-a86a272b5f22'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:28 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:25:28 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:28 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.240s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:28 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:25:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Deleted volume successfully. Aug 28 20:25:28 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7c29f1b3-24f3-4847-aaad-f64bac29d946 tempest-VolumesNegativeTest-395853307 None] Lock "cinder-f831c2b0-75a9-4d6c-87ef-851c121e7077-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:37 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:25:38 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:25:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-7b571753-9c2a-4d86-8d5a-0af66ed0d947 req-40fef9de-58ec-489c-ac87-93d50637c9e7 tempest-TestStampPattern-913350203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-7b571753-9c2a-4d86-8d5a-0af66ed0d947 req-40fef9de-58ec-489c-ac87-93d50637c9e7 tempest-TestStampPattern-913350203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-7b571753-9c2a-4d86-8d5a-0af66ed0d947 req-40fef9de-58ec-489c-ac87-93d50637c9e7 tempest-TestStampPattern-913350203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-7b571753-9c2a-4d86-8d5a-0af66ed0d947 req-40fef9de-58ec-489c-ac87-93d50637c9e7 tempest-TestStampPattern-913350203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de2dbcce-9012-4d13-80bb-950eb132785d', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:25:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-7b571753-9c2a-4d86-8d5a-0af66ed0d947 req-40fef9de-58ec-489c-ac87-93d50637c9e7 tempest-TestStampPattern-913350203 None] attachment_update completed successfully. Aug 28 20:25:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-35d9f51b-31d6-4735-a10b-a0a42548dcd8 req-d9cc64c8-c05e-4ce3-9ea9-b23b2595edec tempest-TestStampPattern-913350203 None] Terminate volume connection completed successfully. Aug 28 20:25:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-35d9f51b-31d6-4735-a10b-a0a42548dcd8 req-d9cc64c8-c05e-4ce3-9ea9-b23b2595edec tempest-TestStampPattern-913350203 None] Deleting attachment de2dbcce-9012-4d13-80bb-950eb132785d. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Flow 'volume_create_manager' (88e2026c-25af-45a0-8b5a-27030a78ae59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddc6521-cae3-46ec-9642-ad3f3d96f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dddc6521-cae3-46ec-9642-ad3f3d96f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2079853768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7831d1-6d32-465b-aad0-3d9ab5a77004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a6dcaec3b264a6e93dc31d111385cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:25:49Z,use_quota=True,user_id='84313567623f4f5a80b468efac5ad81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10abd8cf-7853-4eaf-a21e-ebf47649ba69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10abd8cf-7853-4eaf-a21e-ebf47649ba69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8e1dae-3050-4ee3-85cb-ddc1e85b93cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8e1dae-3050-4ee3-85cb-ddc1e85b93cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7831d1-6d32-465b-aad0-3d9ab5a77004', 'volume_name': 'volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aed6132-8083-4f1d-979f-625bcfd668a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aed6132-8083-4f1d-979f-625bcfd668a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76805cdc-0ae2-4c3a-986a-493735f37760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:49 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Volume 1f7831d1-6d32-465b-aad0-3d9ab5a77004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004', 'volume_size': 1} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2079853768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7831d1-6d32-465b-aad0-3d9ab5a77004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a6dcaec3b264a6e93dc31d111385cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:25:49Z,use_quota=True,user_id='84313567623f4f5a80b468efac5ad81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Creating volume 1f7831d1-6d32-465b-aad0-3d9ab5a77004 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:25:49 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:49 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004 1073741824 Aug 28 20:25:49 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Acquiring lock "cinder-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Lock "cinder-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Acquiring lock "cinder-quobyte-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Flow 'volume_create_manager' (39154664-b993-4910-ae4c-2caea2f3f5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541be72b-dfda-458a-bd6c-ac69a37812fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" acquired by "delete_volume" :: waited 0.061s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (541be72b-dfda-458a-bd6c-ac69a37812fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-166362464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae907bc-f591-4dc1-8b16-f160d63908f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a6dcaec3b264a6e93dc31d111385cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:25:50Z,use_quota=True,user_id='84313567623f4f5a80b468efac5ad81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0704be-8a4b-455c-9578-b602d80bb5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0704be-8a4b-455c-9578-b602d80bb5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88f5bd1-faf4-443f-abf3-3632a3b60f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88f5bd1-faf4-443f-abf3-3632a3b60f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae907bc-f591-4dc1-8b16-f160d63908f7', 'volume_name': 'volume-2ae907bc-f591-4dc1-8b16-f160d63908f7', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2149c2-dd92-4dfb-8f32-07a7d845670c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2149c2-dd92-4dfb-8f32-07a7d845670c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a449b1-45fb-4399-85bb-846c9b96b201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:49 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Volume 2ae907bc-f591-4dc1-8b16-f160d63908f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae907bc-f591-4dc1-8b16-f160d63908f7', 'volume_size': 1} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a8a0e0-a3a2-4c96-ad75-e6133d5f984b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:25:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:50 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004 1073741824" returned: 0 in 0.588s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:50 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c Aug 28 20:25:50 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:50 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004 Aug 28 20:25:50 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:50 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004" returned: 0 in 0.266s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:50 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-166362464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae907bc-f591-4dc1-8b16-f160d63908f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a6dcaec3b264a6e93dc31d111385cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:25:50Z,use_quota=True,user_id='84313567623f4f5a80b468efac5ad81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Creating volume 2ae907bc-f591-4dc1-8b16-f160d63908f7 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:25:50 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" returned: 0 in 0.429s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:50 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7 1073741824 Aug 28 20:25:50 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76805cdc-0ae2-4c3a-986a-493735f37760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:50 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c Aug 28 20:25:50 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2505c6-f96b-4b1b-9332-7898d47f244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:50 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Volume volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004 (1f7831d1-6d32-465b-aad0-3d9ab5a77004): created successfully Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d2505c6-f96b-4b1b-9332-7898d47f244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Flow 'volume_create_manager' (88e2026c-25af-45a0-8b5a-27030a78ae59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:25:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8031a477-130e-4bbb-9ccc-8f7adcf87015 tempest-TestServerVolumeAttachmentScenario-91109554 None] Created volume successfully. Aug 28 20:25:50 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" returned: 0 in 0.305s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c" released by "delete_volume" :: held 0.830s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Created reservations ['f44cc326-6cad-4199-9ced-63b0522ca4f0', 'c984d511-a3e9-41fd-940e-2bd20bf313c0', '9d3f9e5c-b42d-4187-8052-07929072f0dd', 'e8f14705-04af-4441-83b6-d1b8a8f7891b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:50 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:25:50 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:50 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7 1073741824" returned: 0 in 0.566s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:51 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7 Aug 28 20:25:51 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:51 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.308s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:25:51 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Deleted volume successfully. Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-69bd1a5e-59f8-4b25-8c1a-6c9462359093 tempest-TestStampPattern-913350203 None] Lock "cinder-ad2c53ff-4dc2-4b1b-a640-14f0bb10d98c-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Acquiring lock "cinder-b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Lock "cinder-b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Acquiring lock "cinder-quobyte-2f808892-957e-454e-ae46-47f32bbba989" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-2f808892-957e-454e-ae46-47f32bbba989" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Acquiring lock "cinder-quobyte-b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:51 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Deleting offline snapshot b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a of volume 2f808892-957e-454e-ae46-47f32bbba989 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] snapshot_file for this snap is: volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7" returned: 0 in 0.400s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3ad51d-cfeb-4b54-a519-69838f0f5b7d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a449b1-45fb-4399-85bb-846c9b96b201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae907bc-f591-4dc1-8b16-f160d63908f7', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1680352-78aa-4c0c-a139-497368e0dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:25:51 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Volume volume-2ae907bc-f591-4dc1-8b16-f160d63908f7 (2ae907bc-f591-4dc1-8b16-f160d63908f7): created successfully Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1680352-78aa-4c0c-a139-497368e0dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Flow 'volume_create_manager' (39154664-b993-4910-ae4c-2caea2f3f5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:25:51 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-eacdcedf-a4a2-4811-9596-76e4c8763de1 tempest-TestServerVolumeAttachmentScenario-91109554 None] Created volume successfully. Aug 28 20:25:51 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a Aug 28 20:25:51 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:51 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a" returned: 0 in 0.380s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f808892-957e-454e-ae46-47f32bbba989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec506a5-005c-4c8e-b6c5-ace34ed6b682]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:25:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:51 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 Aug 28 20:25:51 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:52 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989" returned: 0 in 0.545s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:52 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a Aug 28 20:25:52 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:52 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a" returned: 0 in 0.385s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:52 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a Aug 28 20:25:52 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:53 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989.b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a" released by "_delete_snapshot" :: held 1.674s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-2f808892-957e-454e-ae46-47f32bbba989" released by "delete_snapshot" :: held 1.705s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:53 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Created reservations ['b15d7d60-38f9-4822-92b3-dcf4d0b9f3d2', '92ba303f-558a-4b05-a9b4-8165ee3069a8', '0c80584b-338e-4dd5-9a7f-5e001c39b284', '0bc6fa98-3c97-45de-8f63-efd78c48a782'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:25:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Delete snapshot completed successfully. Aug 28 20:25:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7f4bf8f4-15e6-4923-90ad-1825889f8f2e tempest-TestStampPattern-913350203 None] Lock "cinder-b47dd82e-29b0-4a99-8bfb-c4b4b8266a5a-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Acquiring lock "cinder-2f808892-957e-454e-ae46-47f32bbba989-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Lock "cinder-2f808892-957e-454e-ae46-47f32bbba989-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Acquiring lock "cinder-quobyte-2f808892-957e-454e-ae46-47f32bbba989" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:25:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-2f808892-957e-454e-ae46-47f32bbba989" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:25:58 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[015aba66-5e36-42ff-926e-90a46af4275a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:25:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:58 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 Aug 28 20:25:58 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:58 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989" returned: 0 in 0.484s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:58 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989 Aug 28 20:25:58 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:58 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2f808892-957e-454e-ae46-47f32bbba989" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Lock "cinder-quobyte-2f808892-957e-454e-ae46-47f32bbba989" released by "delete_volume" :: held 0.839s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:25:59 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Created reservations ['1f9d3566-a44b-4325-b0fb-316f65bccd39', '1efd23d1-ee83-4c47-a6fb-21323c50f4c7', 'f37aac51-7314-4958-9a58-c2ea2a49b9bb', 'ed5ebe87-6155-4144-9c81-fdd04e887d33'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:25:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:25:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:25:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:25:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:25:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:25:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:25:59 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:25:59 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:25:59 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Aug 28 20:25:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.417s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:25:59 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:25:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Deleted volume successfully. Aug 28 20:25:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-2a4b5303-5a08-4c4e-ade1-3b36c34e7d7b tempest-TestStampPattern-913350203 None] Lock "cinder-2f808892-957e-454e-ae46-47f32bbba989-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:26:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:06 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:06 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:07 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.257s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:26:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:26:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:26:09 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=30,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:26:09 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=25,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Flow 'volume_create_manager' (b5d2cb37-9234-4d62-8107-99993e4b745a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2f4f9e-c4e2-43f0-991d-39234026c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2f4f9e-c4e2-43f0-991d-39234026c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b45a45-cc7c-4ef8-a182-04e7369f0049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcd1fcff54f72bcf4bcb831a61460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:15Z,use_quota=True,user_id='3480a0479dcf45c094ba418b04ad6e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b8f7a14-70ea-43ee-8065-593e2f163b74),volume_type_id=8b8f7a14-70ea-43ee-8065-593e2f163b74)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91364b6-9c81-4c83-ad29-c6bbc03271eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91364b6-9c81-4c83-ad29-c6bbc03271eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46508834-9104-4b79-9480-bc56debbdb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.image.glance [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Creating Keystone auth plugin from conf {{(pid=86028) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46508834-9104-4b79-9480-bc56debbdb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5b45a45-cc7c-4ef8-a182-04e7369f0049', 'volume_name': 'volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049', 'volume_size': 1, 'image_id': 'b7df13d4-730e-4366-babe-41fbdf91b2d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7df13d4-730e-4366-babe-41fbdf91b2d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93f58e8e387565d15556f59efa8dfaad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '562fcd1fcff54f72bcf4bcb831a61460', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0a981296f4a4f09ec0aa841da9be1d73612581966cefb6c659caf145a54248b152739a4e5f69f12f94fef24c44c24e0f4cb97c84c2c9100e6ffa618996d6da5', 'id': 'b7df13d4-730e-4366-babe-41fbdf91b2d6', 'created_at': datetime.datetime(2026, 8, 28, 18, 26, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 26, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7df13d4-730e-4366-babe-41fbdf91b2d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67ab1c4-e18a-481f-9c1f-10d44da4d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67ab1c4-e18a-481f-9c1f-10d44da4d371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d3e436-4f17-40a4-92bf-78d6e2ea0032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:15 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Volume a5b45a45-cc7c-4ef8-a182-04e7369f0049: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049', 'volume_size': 1, 'image_id': 'b7df13d4-730e-4366-babe-41fbdf91b2d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7df13d4-730e-4366-babe-41fbdf91b2d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93f58e8e387565d15556f59efa8dfaad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '562fcd1fcff54f72bcf4bcb831a61460', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0a981296f4a4f09ec0aa841da9be1d73612581966cefb6c659caf145a54248b152739a4e5f69f12f94fef24c44c24e0f4cb97c84c2c9100e6ffa618996d6da5', 'id': 'b7df13d4-730e-4366-babe-41fbdf91b2d6', 'created_at': datetime.datetime(2026, 8, 28, 18, 26, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 26, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7df13d4-730e-4366-babe-41fbdf91b2d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Trying to clone a5b45a45-cc7c-4ef8-a182-04e7369f0049 from image b7df13d4-730e-4366-babe-41fbdf91b2d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7df13d4-730e-4366-babe-41fbdf91b2d6', 'metadata': {}}]). {{(pid=86028) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 20:26:15 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Image download 0.00 MB at 0.00 MB/s Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1160155d-2004-4dc7-bbb0-2daebf299e1a]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:15 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD Aug 28 20:26:15 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:15 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:15 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD Aug 28 20:26:15 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:16 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Temporary image b7df13d4-730e-4366-babe-41fbdf91b2d6 is fetched for user 3480a0479dcf45c094ba418b04ad6e6c. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd938b33-93d6-4d89-8b10-a2705b2c666a]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:16 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD Aug 28 20:26:16 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:16 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:16 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD Aug 28 20:26:16 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:16 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b45a45-cc7c-4ef8-a182-04e7369f0049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562fcd1fcff54f72bcf4bcb831a61460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:15Z,use_quota=True,user_id='3480a0479dcf45c094ba418b04ad6e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b8f7a14-70ea-43ee-8065-593e2f163b74),volume_type_id=8b8f7a14-70ea-43ee-8065-593e2f163b74)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Creating volume a5b45a45-cc7c-4ef8-a182-04e7369f0049 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:26:16 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:26:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:16 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 1073741824 Aug 28 20:26:16 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:17 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 1073741824" returned: 0 in 0.408s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:17 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 Aug 28 20:26:17 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:17 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049" returned: 0 in 0.265s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:26:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:17 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Attempting download of b7df13d4-730e-4366-babe-41fbdf91b2d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7df13d4-730e-4366-babe-41fbdf91b2d6', 'metadata': {}}])) to volume a5b45a45-cc7c-4ef8-a182-04e7369f0049. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 20:26:17 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c1fb48-7d65-4d70-9718-ab135a247f5b]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7df13d4-730e-4366-babe-41fbdf91b2d6_3ky1rljn {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:17 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7df13d4-730e-4366-babe-41fbdf91b2d6_3ky1rljn Aug 28 20:26:17 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:17 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7df13d4-730e-4366-babe-41fbdf91b2d6_3ky1rljn" returned: 0 in 0.347s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7df13d4-730e-4366-babe-41fbdf91b2d6_3ky1rljn {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:18 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7df13d4-730e-4366-babe-41fbdf91b2d6_3ky1rljn Aug 28 20:26:18 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:18 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7df13d4-730e-4366-babe-41fbdf91b2d6_3ky1rljn" returned: 1 in 0.328s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7df13d4-730e-4366-babe-41fbdf91b2d6_3ky1rljn' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:26:18 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a71ea6-1097-45bb-895e-b4085aa523c0]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:18 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD Aug 28 20:26:18 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:18 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:18 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD Aug 28 20:26:18 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:19 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] b7df13d4-730e-4366-babe-41fbdf91b2d6 was raw, converting to qcow2 {{(pid=86028) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:19 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 Aug 28 20:26:19 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:19 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049" returned: 0 in 0.425s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7df13d4-730e-4366-babe-41fbdf91b2d6_64en5c1odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:26:19 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:19 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 1G Aug 28 20:26:19 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:19 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 1G" returned: 0 in 0.293s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Downloaded image b7df13d4-730e-4366-babe-41fbdf91b2d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7df13d4-730e-4366-babe-41fbdf91b2d6', 'metadata': {}}])) to volume a5b45a45-cc7c-4ef8-a182-04e7369f0049 successfully. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Temporary image b7df13d4-730e-4366-babe-41fbdf91b2d6 for user 3480a0479dcf45c094ba418b04ad6e6c is deleted. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Marking volume a5b45a45-cc7c-4ef8-a182-04e7369f0049 as bootable. {{(pid=86028) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Copying metadata from image b7df13d4-730e-4366-babe-41fbdf91b2d6 to a5b45a45-cc7c-4ef8-a182-04e7369f0049. {{(pid=86028) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Creating volume glance metadata for volume a5b45a45-cc7c-4ef8-a182-04e7369f0049 backed by image b7df13d4-730e-4366-babe-41fbdf91b2d6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b7df13d4-730e-4366-babe-41fbdf91b2d6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '93f58e8e387565d15556f59efa8dfaad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86028) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d3e436-4f17-40a4-92bf-78d6e2ea0032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049', 'volume_size': 1, 'image_id': 'b7df13d4-730e-4366-babe-41fbdf91b2d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7df13d4-730e-4366-babe-41fbdf91b2d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93f58e8e387565d15556f59efa8dfaad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '562fcd1fcff54f72bcf4bcb831a61460', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0a981296f4a4f09ec0aa841da9be1d73612581966cefb6c659caf145a54248b152739a4e5f69f12f94fef24c44c24e0f4cb97c84c2c9100e6ffa618996d6da5', 'id': 'b7df13d4-730e-4366-babe-41fbdf91b2d6', 'created_at': datetime.datetime(2026, 8, 28, 18, 26, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 26, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7df13d4-730e-4366-babe-41fbdf91b2d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3f4bc1-cca2-4f91-8c4d-e29b6cc3f5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:19 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Volume volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 (a5b45a45-cc7c-4ef8-a182-04e7369f0049): created successfully Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3f4bc1-cca2-4f91-8c4d-e29b6cc3f5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Flow 'volume_create_manager' (b5d2cb37-9234-4d62-8107-99993e4b745a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:19 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a46bb51b-d398-4ad1-8d9c-ad546a9162bc tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Created volume successfully. Aug 28 20:26:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Acquiring lock "cinder-a5b45a45-cc7c-4ef8-a182-04e7369f0049-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Lock "cinder-a5b45a45-cc7c-4ef8-a182-04e7369f0049-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Acquiring lock "cinder-quobyte-a5b45a45-cc7c-4ef8-a182-04e7369f0049" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Lock "cinder-quobyte-a5b45a45-cc7c-4ef8-a182-04e7369f0049" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:20 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0345dc8b-49ff-4a81-967e-58f2ca4e0b89]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:20 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 Aug 28 20:26:20 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:20 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049" returned: 0 in 0.342s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:20 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049 Aug 28 20:26:20 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:21 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5b45a45-cc7c-4ef8-a182-04e7369f0049" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Lock "cinder-quobyte-a5b45a45-cc7c-4ef8-a182-04e7369f0049" released by "delete_volume" :: held 0.618s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:21 devstack cinder-volume[86028]: WARNING cinder.quota [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:26:21 devstack cinder-volume[86028]: WARNING cinder.quota [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Created reservations ['8e37bd2e-e6dd-4722-8905-513643fd81c2', '52c7480a-9dfc-43a5-ac9e-9d0336caf91f', '6d37b84e-4071-4140-96d5-94abbaa805de', '3bcb123c-b17f-41bc-8e3d-8d1e24bd25be'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:21 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:21 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:21 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.249s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Deleted volume successfully. Aug 28 20:26:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cb78ce6a-f8e0-4ed4-ba4b-8a6f738c290a tempest-VolumeAndVolumeTypeFromImageTest-1807914230 None] Lock "cinder-a5b45a45-cc7c-4ef8-a182-04e7369f0049-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-f2d67f6d-446a-41eb-a9e8-408227788311 req-a96f4b07-f54f-420c-a6bf-2883a9839e12 tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-f2d67f6d-446a-41eb-a9e8-408227788311 req-a96f4b07-f54f-420c-a6bf-2883a9839e12 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-f2d67f6d-446a-41eb-a9e8-408227788311 req-a96f4b07-f54f-420c-a6bf-2883a9839e12 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-f2d67f6d-446a-41eb-a9e8-408227788311 req-a96f4b07-f54f-420c-a6bf-2883a9839e12 tempest-TestServerVolumeAttachmentScenario-91109554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fc0acc8-746c-44d7-99b4-eaaa449c1146', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:26:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-f2d67f6d-446a-41eb-a9e8-408227788311 req-a96f4b07-f54f-420c-a6bf-2883a9839e12 tempest-TestServerVolumeAttachmentScenario-91109554 None] attachment_update completed successfully. Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (69d32035-1de1-4258-82d2-e19a94b8e2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29fbffa8-7d63-4452-995c-9abd4fba016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29fbffa8-7d63-4452-995c-9abd4fba016c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062262071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b23d02-bd9a-4aaa-8435-b26a75e7b98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:26Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7979be1-5c5b-4bf8-9168-7fbc41e8bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7979be1-5c5b-4bf8-9168-7fbc41e8bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8e4693-5470-4a3d-ad8c-c301552d18d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8e4693-5470-4a3d-ad8c-c301552d18d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b23d02-bd9a-4aaa-8435-b26a75e7b98a', 'volume_name': 'volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37023269-b4f8-43e7-8176-c45a805ee855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37023269-b4f8-43e7-8176-c45a805ee855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd526c8-1a67-465b-b2f0-c7d772519d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:25 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume 17b23d02-bd9a-4aaa-8435-b26a75e7b98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a', 'volume_size': 1} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062262071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b23d02-bd9a-4aaa-8435-b26a75e7b98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:26Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Creating volume 17b23d02-bd9a-4aaa-8435-b26a75e7b98a {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:26:25 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:26:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:25 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a 1073741824 Aug 28 20:26:25 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:26 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a 1073741824" returned: 0 in 0.441s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:26 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a Aug 28 20:26:26 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:26 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" returned: 0 in 0.244s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd526c8-1a67-465b-b2f0-c7d772519d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f60dff8-069b-457a-8b1c-ef5961c2a984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:26 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a (17b23d02-bd9a-4aaa-8435-b26a75e7b98a): created successfully Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f60dff8-069b-457a-8b1c-ef5961c2a984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (69d32035-1de1-4258-82d2-e19a94b8e2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:26 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-09c7dc64-14a6-4171-afb6-7d953f7f3cee tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created volume successfully. Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Creating offline snapshot fe3ec20a-4845-498e-8561-102311ca9413 of volume 17b23d02-bd9a-4aaa-8435-b26a75e7b98a {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:26:27 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[496606cc-1227-4832-91be-7ebaaac81fef]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:27 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a Aug 28 20:26:27 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:27 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" returned: 0 in 0.396s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:27 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 1G Aug 28 20:26:27 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-2ad29ed8-eed7-4738-85ef-00c0031a55a1 req-18b3489a-e209-40ec-827a-56091f90a39c tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:27 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 1G" returned: 0 in 0.378s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:27 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 Aug 28 20:26:27 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:28 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413" returned: 0 in 0.275s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:28 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 is being set with open permissions: ugo+rw Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:28 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 Aug 28 20:26:28 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:28 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:28 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.info Aug 28 20:26:28 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:28 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.info" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:28 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.info is being set with open permissions: ugo+rw Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:28 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.info Aug 28 20:26:28 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:28 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.info" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-2ad29ed8-eed7-4738-85ef-00c0031a55a1 req-18b3489a-e209-40ec-827a-56091f90a39c tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.350s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-2ad29ed8-eed7-4738-85ef-00c0031a55a1 req-18b3489a-e209-40ec-827a-56091f90a39c tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-acc87063-6c38-4b4a-baad-ad9c2fc748a1 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Create snapshot completed successfully Aug 28 20:26:28 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-2ad29ed8-eed7-4738-85ef-00c0031a55a1 req-18b3489a-e209-40ec-827a-56091f90a39c tempest-TestServerVolumeAttachmentScenario-91109554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-2ae907bc-f591-4dc1-8b16-f160d63908f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d0b20f1-db76-4ba0-ad30-43530a369602', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:26:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-2ad29ed8-eed7-4738-85ef-00c0031a55a1 req-18b3489a-e209-40ec-827a-56091f90a39c tempest-TestServerVolumeAttachmentScenario-91109554 None] attachment_update completed successfully. Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (3c8bee95-5560-4591-9cba-141bc603b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f8c846-5df8-46fa-8d86-40cd7c5bf880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f8c846-5df8-46fa-8d86-40cd7c5bf880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067461201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d007cace-e924-4fbe-876f-b878c4acd5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:30Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e7c82b-51a2-461a-bbcd-95e3cbb1070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e7c82b-51a2-461a-bbcd-95e3cbb1070e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2c5ab2-f338-4667-8d84-9925d3346d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2c5ab2-f338-4667-8d84-9925d3346d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd007cace-e924-4fbe-876f-b878c4acd5ad', 'volume_name': 'volume-d007cace-e924-4fbe-876f-b878c4acd5ad', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7089c4ff-4fcc-469f-91d7-ac520943ba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7089c4ff-4fcc-469f-91d7-ac520943ba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368ff9f4-710f-426a-83cd-ea9992f6f87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:29 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume d007cace-e924-4fbe-876f-b878c4acd5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d007cace-e924-4fbe-876f-b878c4acd5ad', 'volume_size': 1} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2067461201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d007cace-e924-4fbe-876f-b878c4acd5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:30Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Creating volume d007cace-e924-4fbe-876f-b878c4acd5ad {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:26:29 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:26:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:29 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad 1073741824 Aug 28 20:26:29 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (a7e70189-3315-4a19-bfc2-1f62ca29f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e434148f-9bf6-401f-bdf2-e2066301855b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e434148f-9bf6-401f-bdf2-e2066301855b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1927251886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42dcfe4-a846-4238-af98-e13071963f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:30Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1043dd6-712e-4eac-b6cc-8818339472e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1043dd6-712e-4eac-b6cc-8818339472e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df78f200-d72c-4bdc-9aee-125f8f240cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df78f200-d72c-4bdc-9aee-125f8f240cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd42dcfe4-a846-4238-af98-e13071963f78', 'volume_name': 'volume-d42dcfe4-a846-4238-af98-e13071963f78', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52819c4a-328a-457f-a7d9-5e0718977723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52819c4a-328a-457f-a7d9-5e0718977723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f43140-4d5d-4007-9e38-b80969e09d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume d42dcfe4-a846-4238-af98-e13071963f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d42dcfe4-a846-4238-af98-e13071963f78', 'volume_size': 1} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:30 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad 1073741824" returned: 0 in 0.509s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:30 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad Aug 28 20:26:30 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (3503ebce-6d38-4945-8fba-97fddb95abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b914e0a3-0c04-4e5e-ab39-bdbf02daf547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b914e0a3-0c04-4e5e-ab39-bdbf02daf547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1208977733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df979d1-2476-4b2e-9e7d-6e0b4032f06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:30Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1a8808-4f57-4b78-930e-aaffcd4c7917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1a8808-4f57-4b78-930e-aaffcd4c7917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8514ffb4-4922-4895-8cb3-4443a7179f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8514ffb4-4922-4895-8cb3-4443a7179f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df979d1-2476-4b2e-9e7d-6e0b4032f06c', 'volume_name': 'volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847c6686-4b9a-44c8-a08b-6c471b530d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847c6686-4b9a-44c8-a08b-6c471b530d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b70b684-6e9a-4091-b482-b3721edd9c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume 6df979d1-2476-4b2e-9e7d-6e0b4032f06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c', 'volume_size': 1} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:30 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad" returned: 0 in 0.288s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1927251886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42dcfe4-a846-4238-af98-e13071963f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:30Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Creating volume d42dcfe4-a846-4238-af98-e13071963f78 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:26:30 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368ff9f4-710f-426a-83cd-ea9992f6f87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d007cace-e924-4fbe-876f-b878c4acd5ad', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78 1073741824 Aug 28 20:26:30 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039ee32e-0d1c-443b-93b8-038bc7920ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume volume-d007cace-e924-4fbe-876f-b878c4acd5ad (d007cace-e924-4fbe-876f-b878c4acd5ad): created successfully Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039ee32e-0d1c-443b-93b8-038bc7920ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (3c8bee95-5560-4591-9cba-141bc603b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:30 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ce9ec916-cfff-41cf-93f4-d9b68cc9761e tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created volume successfully. Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (7330be54-da2d-4a91-9c6b-05bfa82f3a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d56a0cf-df3b-4a4d-9bf2-9066ee233f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d56a0cf-df3b-4a4d-9bf2-9066ee233f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1646172066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfbcc50-90b6-4d77-8332-78efe6fa5a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:31Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648d5db1-eb82-4ec2-bb78-50383a7c1946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648d5db1-eb82-4ec2-bb78-50383a7c1946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9701816d-10be-4b98-87eb-dd87bda5a4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9701816d-10be-4b98-87eb-dd87bda5a4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfbcc50-90b6-4d77-8332-78efe6fa5a45', 'volume_name': 'volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00726228-2fd2-4076-8282-6d9f65d5d178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00726228-2fd2-4076-8282-6d9f65d5d178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb8bbc8-0d68-427d-b49a-0e1875a05fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:30 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume 8dfbcc50-90b6-4d77-8332-78efe6fa5a45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45', 'volume_size': 1} Aug 28 20:26:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:31 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78 1073741824" returned: 0 in 0.663s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:31 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78 Aug 28 20:26:31 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:31 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-bffd9f76-c0f2-4609-9e03-2e989fd55450 req-bda1a191-0fc8-4648-8156-9c3fc7779682 tempest-TestServerVolumeAttachmentScenario-91109554 None] Terminate volume connection completed successfully. Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-bffd9f76-c0f2-4609-9e03-2e989fd55450 req-bda1a191-0fc8-4648-8156-9c3fc7779682 tempest-TestServerVolumeAttachmentScenario-91109554 None] Deleting attachment 6d0b20f1-db76-4ba0-ad30-43530a369602. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (634cad00-57d5-4e49-866a-57196f2dcfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789b9d51-f5ab-421a-992d-7adbbf4ac082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789b9d51-f5ab-421a-992d-7adbbf4ac082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1618797161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7700886b-b8d2-4f97-a5c8-b1dd22bc7b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:31Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c08511b-74cb-49af-8e56-85b2b160d720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c08511b-74cb-49af-8e56-85b2b160d720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e25066-e480-40a8-bb9f-f94e2ea7517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e25066-e480-40a8-bb9f-f94e2ea7517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7700886b-b8d2-4f97-a5c8-b1dd22bc7b98', 'volume_name': 'volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9884199e-a1df-49e0-83e2-7232e0899153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9884199e-a1df-49e0-83e2-7232e0899153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d78fe1-5bb1-466c-97b1-86c91a3c1b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:31 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume 7700886b-b8d2-4f97-a5c8-b1dd22bc7b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98', 'volume_size': 1} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:31 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78" returned: 0 in 0.280s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.136s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1208977733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df979d1-2476-4b2e-9e7d-6e0b4032f06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:30Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Creating volume 6df979d1-2476-4b2e-9e7d-6e0b4032f06c {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:26:31 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f43140-4d5d-4007-9e38-b80969e09d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d42dcfe4-a846-4238-af98-e13071963f78', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:31 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c 1073741824 Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a011f1-0b3b-4cff-9418-73f3d05406aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:31 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:31 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume volume-d42dcfe4-a846-4238-af98-e13071963f78 (d42dcfe4-a846-4238-af98-e13071963f78): created successfully Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a011f1-0b3b-4cff-9418-73f3d05406aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (a7e70189-3315-4a19-bfc2-1f62ca29f510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:31 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9a050dd8-8c6c-4375-9f0e-681ab80d2960 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created volume successfully. Aug 28 20:26:32 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c 1073741824" returned: 0 in 0.408s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:32 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c Aug 28 20:26:32 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:32 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c" returned: 0 in 0.258s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1646172066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfbcc50-90b6-4d77-8332-78efe6fa5a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:31Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Creating volume 8dfbcc50-90b6-4d77-8332-78efe6fa5a45 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:26:32 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b70b684-6e9a-4091-b482-b3721edd9c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:32 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45 1073741824 Aug 28 20:26:32 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896c2f67-00ee-4473-88d8-29a22b73e802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:32 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c (6df979d1-2476-4b2e-9e7d-6e0b4032f06c): created successfully Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896c2f67-00ee-4473-88d8-29a22b73e802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (3503ebce-6d38-4945-8fba-97fddb95abc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-36dafd60-7fe8-4cb8-965c-415efe6a3b70 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created volume successfully. Aug 28 20:26:32 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45 1073741824" returned: 0 in 0.468s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:32 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45 Aug 28 20:26:32 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-7ab5f639-b199-46f7-95a4-ed8287f4c127 req-380778dd-f0ae-4093-ad95-d5f31f33e866 tempest-TestServerVolumeAttachmentScenario-91109554 None] Terminate volume connection completed successfully. Aug 28 20:26:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-7ab5f639-b199-46f7-95a4-ed8287f4c127 req-380778dd-f0ae-4093-ad95-d5f31f33e866 tempest-TestServerVolumeAttachmentScenario-91109554 None] Deleting attachment 5fc0acc8-746c-44d7-99b4-eaaa449c1146. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:26:33 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45" returned: 0 in 0.286s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.592s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1618797161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7700886b-b8d2-4f97-a5c8-b1dd22bc7b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50102a878f2c4408826d65224d4ac8d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:31Z,use_quota=True,user_id='da8645d8fea14054813ac1d0ebf7c499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Creating volume 7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:26:33 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb8bbc8-0d68-427d-b49a-0e1875a05fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:33 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 1073741824 Aug 28 20:26:33 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cddfa0-ba6b-4b91-877f-8f0fb15a4c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:33 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45 (8dfbcc50-90b6-4d77-8332-78efe6fa5a45): created successfully Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cddfa0-ba6b-4b91-877f-8f0fb15a4c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (7330be54-da2d-4a91-9c6b-05bfa82f3a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-94d8fd03-4c21-49ed-aab8-1192fc9766f5 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created volume successfully. Aug 28 20:26:33 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 1073741824" returned: 0 in 0.430s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:33 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 Aug 28 20:26:33 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:33 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d78fe1-5bb1-466c-97b1-86c91a3c1b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89df95e0-c4b5-4737-844f-7198e959400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:33 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Volume volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 (7700886b-b8d2-4f97-a5c8-b1dd22bc7b98): created successfully Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89df95e0-c4b5-4737-844f-7198e959400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Flow 'volume_create_manager' (634cad00-57d5-4e49-866a-57196f2dcfb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-119127db-3bcd-423e-b880-56a5f7ceef84 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created volume successfully. Aug 28 20:26:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-quobyte-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:34 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f3091c-1f86-42ba-ad05-a1fb89cb7b8f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:35 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 Aug 28 20:26:35 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:35 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98" returned: 0 in 0.449s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:35 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98 Aug 28 20:26:35 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:35 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98" returned: 0 in 0.329s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98" released by "delete_volume" :: held 0.822s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created reservations ['e2fad12d-55d1-4844-a213-76abf94091f3', '55fb3395-810f-419c-abae-506b9fd5e42c', '7d19c974-1f71-44cb-aa51-9d6ed1538afd', '0f0af2e7-e986-48cc-8aef-bef8b3918bfe'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:35 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:35 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-8dfbcc50-90b6-4d77-8332-78efe6fa5a45-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-8dfbcc50-90b6-4d77-8332-78efe6fa5a45-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-quobyte-8dfbcc50-90b6-4d77-8332-78efe6fa5a45" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-8dfbcc50-90b6-4d77-8332-78efe6fa5a45" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e1df8a-5fde-448e-ae31-8f9e7eec5ba8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:36 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.298s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:36 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Deleted volume successfully. Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2bc3070-e9f9-4dac-a2fb-1579ab4c6edf tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-7700886b-b8d2-4f97-a5c8-b1dd22bc7b98-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:36 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45 Aug 28 20:26:36 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:36 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45" returned: 0 in 0.369s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:36 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45 Aug 28 20:26:36 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:36 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-8dfbcc50-90b6-4d77-8332-78efe6fa5a45" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-8dfbcc50-90b6-4d77-8332-78efe6fa5a45" released by "delete_volume" :: held 0.687s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created reservations ['29f3d199-b080-4b51-a258-8c1f82a36538', '12e7efb5-23bd-43bc-9df4-22f9f5e7c70a', '46e4a395-4dc1-40e9-806b-aeb2e91b52f4', 'a843658a-06b6-49a2-a97a-4e73f7e36967'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:36 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:36 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-6df979d1-2476-4b2e-9e7d-6e0b4032f06c-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-6df979d1-2476-4b2e-9e7d-6e0b4032f06c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-quobyte-6df979d1-2476-4b2e-9e7d-6e0b4032f06c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-6df979d1-2476-4b2e-9e7d-6e0b4032f06c" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:37 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.300s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:37 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Deleted volume successfully. Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b36210-77c0-4599-987e-95e30d956acc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4818fc9e-e068-4227-9d42-a008b26f1316 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-8dfbcc50-90b6-4d77-8332-78efe6fa5a45-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:37 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c Aug 28 20:26:37 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "cinder-2ae907bc-f591-4dc1-8b16-f160d63908f7-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "cinder-2ae907bc-f591-4dc1-8b16-f160d63908f7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "cinder-quobyte-2ae907bc-f591-4dc1-8b16-f160d63908f7" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "cinder-quobyte-2ae907bc-f591-4dc1-8b16-f160d63908f7" acquired by "delete_volume" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ca83f4-45d0-4b0f-b5f9-2e11aa843579]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:37 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c" returned: 0 in 0.403s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:37 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c Aug 28 20:26:37 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:37 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7 Aug 28 20:26:37 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:37 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6df979d1-2476-4b2e-9e7d-6e0b4032f06c" returned: 0 in 0.260s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-6df979d1-2476-4b2e-9e7d-6e0b4032f06c" released by "delete_volume" :: held 0.709s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:37 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:37 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created reservations ['de1aaae6-a913-43ae-aeb3-fa442b1c639b', '76ceace2-c3a9-43ba-a509-6578ba2e97e0', 'b1a2849c-1a09-4f78-9647-04c0475ec282', 'bcb5cfdb-eb7a-46ad-b2bd-468c9a26eb8c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7" returned: 0 in 0.357s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:38 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7 Aug 28 20:26:38 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:38 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:38 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:38 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-2ae907bc-f591-4dc1-8b16-f160d63908f7" returned: 0 in 0.266s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "cinder-quobyte-2ae907bc-f591-4dc1-8b16-f160d63908f7" released by "delete_volume" :: held 0.667s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-d42dcfe4-a846-4238-af98-e13071963f78-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:38 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.264s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Created reservations ['5a954bf2-c945-42ce-9bd4-c1a7dce1e85b', '3748d500-1b93-4747-9605-8b405a0dcc15', '1afdbf82-d65b-4679-899e-935eb212ae0f', '613ef2bb-99c1-4b46-a2fc-4a4a1d218691'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Deleted volume successfully. Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-d42dcfe4-a846-4238-af98-e13071963f78-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f04bb3ca-9065-4761-a197-cdf976fa2f54 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-6df979d1-2476-4b2e-9e7d-6e0b4032f06c-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-quobyte-d42dcfe4-a846-4238-af98-e13071963f78" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-d42dcfe4-a846-4238-af98-e13071963f78" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dcfca6-e907-40f4-bb10-c01cb0a72a9b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:38 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:38 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:38 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78 Aug 28 20:26:38 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:38 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "cinder-1f7831d1-6d32-465b-aad0-3d9ab5a77004-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.259s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Deleted volume successfully. Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "cinder-1f7831d1-6d32-465b-aad0-3d9ab5a77004-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b8d7fb0c-3cad-45af-ac4c-6821453f58bc tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "cinder-2ae907bc-f591-4dc1-8b16-f160d63908f7-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "cinder-quobyte-1f7831d1-6d32-465b-aad0-3d9ab5a77004" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "cinder-quobyte-1f7831d1-6d32-465b-aad0-3d9ab5a77004" acquired by "delete_volume" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ff20af-ec2d-4c3a-b1eb-b40dbbc2fae0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:38 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78" returned: 0 in 0.402s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:38 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78 Aug 28 20:26:38 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:38 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004 Aug 28 20:26:38 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:39 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d42dcfe4-a846-4238-af98-e13071963f78" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-d42dcfe4-a846-4238-af98-e13071963f78" released by "delete_volume" :: held 0.707s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:39 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004" returned: 0 in 0.360s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created reservations ['250ffcda-18b9-43c8-b861-664e0d89585e', 'fef9f68e-462e-4d1a-b990-fca47027f8bc', 'a91133d1-fa5d-4217-9450-ee0eb35b5955', 'd9b62a2f-b63b-44ee-9b23-7786495345f5'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:39 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004 Aug 28 20:26:39 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:39 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:39 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:39 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-1f7831d1-6d32-465b-aad0-3d9ab5a77004" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "cinder-quobyte-1f7831d1-6d32-465b-aad0-3d9ab5a77004" released by "delete_volume" :: held 0.656s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-d007cace-e924-4fbe-876f-b878c4acd5ad-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-d007cace-e924-4fbe-876f-b878c4acd5ad-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Created reservations ['8bdcb369-f040-471a-acdb-60667393d158', '75002c2f-1ed7-4410-aacd-ac183058ca30', 'ac9b9133-1b2b-4800-80d3-339ad885f452', 'a26abca2-96ac-45c0-800e-6ce868d8f85b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-quobyte-d007cace-e924-4fbe-876f-b878c4acd5ad" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-d007cace-e924-4fbe-876f-b878c4acd5ad" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:39 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.287s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Deleted volume successfully. Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[201b7a60-c5a8-4ad5-b63f-3636022f0c01]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ec352d7-fcd4-4559-a664-40ac2c06d309 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-d42dcfe4-a846-4238-af98-e13071963f78-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:39 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:39 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:39 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad Aug 28 20:26:39 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:39 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.265s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Deleted volume successfully. Aug 28 20:26:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c99053b4-10a9-4f65-b4bb-07ac7ef08411 tempest-TestServerVolumeAttachmentScenario-91109554 None] Lock "cinder-1f7831d1-6d32-465b-aad0-3d9ab5a77004-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:40 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad" returned: 0 in 0.381s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:40 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad Aug 28 20:26:40 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:40 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d007cace-e924-4fbe-876f-b878c4acd5ad" returned: 0 in 0.257s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-d007cace-e924-4fbe-876f-b878c4acd5ad" released by "delete_volume" :: held 0.685s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created reservations ['fc807fb8-db2b-4ab3-996d-f36c210a49cd', 'e0196752-0a14-4b02-8107-88cf3156d928', '7372ea42-0cbd-4295-aeac-5853802d2ddf', 'd0fc2cb7-efb6-4c85-b15b-28ac908621a1'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:40 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:40 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-fe3ec20a-4845-498e-8561-102311ca9413-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:40 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.308s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-fe3ec20a-4845-498e-8561-102311ca9413-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-quobyte-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Deleted volume successfully. Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-quobyte-fe3ec20a-4845-498e-8561-102311ca9413" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-db43d083-ee87-4180-8a3a-732163388124 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-d007cace-e924-4fbe-876f-b878c4acd5ad-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-fe3ec20a-4845-498e-8561-102311ca9413" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Deleting offline snapshot fe3ec20a-4845-498e-8561-102311ca9413 of volume 17b23d02-bd9a-4aaa-8435-b26a75e7b98a {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] snapshot_file for this snap is: volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[739157df-f337-4022-a365-19c3517b9f0b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:40 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 Aug 28 20:26:40 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:41 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413" returned: 0 in 0.356s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:26:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd9cb4-a46f-4ad1-aec1-9d4c4f3d6b18]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:41 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a Aug 28 20:26:41 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:41 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" returned: 0 in 0.380s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:41 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 Aug 28 20:26:41 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:41 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413" returned: 0 in 0.328s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:41 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413 Aug 28 20:26:41 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:42 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a.fe3ec20a-4845-498e-8561-102311ca9413" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-fe3ec20a-4845-498e-8561-102311ca9413" released by "_delete_snapshot" :: held 1.409s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" released by "delete_snapshot" :: held 1.440s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created reservations ['d0bf0305-1d88-4306-abb1-d563e8822cda', '336d077e-a7a8-4336-9adc-b9a2981d5ec6', '7b93a444-a6c9-4f67-a0c3-dcd2c050da79', '85e5fc40-b87c-4308-a58a-f1a0e29ab795'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:42 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Delete snapshot completed successfully. Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7cc8aff-c3a4-4f84-9635-d39dedce3241 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-fe3ec20a-4845-498e-8561-102311ca9413-delete_snapshot" released by "delete_snapshot" :: held 1.609s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-17b23d02-bd9a-4aaa-8435-b26a75e7b98a-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-17b23d02-bd9a-4aaa-8435-b26a75e7b98a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "cinder-quobyte-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f22f16f-de37-40f0-a8a4-302de92fd260]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:43 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a Aug 28 20:26:43 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:43 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" returned: 0 in 0.413s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:43 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a Aug 28 20:26:43 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:43 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" returned: 0 in 0.259s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-quobyte-17b23d02-bd9a-4aaa-8435-b26a75e7b98a" released by "delete_volume" :: held 0.729s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Created reservations ['1b57c420-3085-49ff-9a3d-c6f6aa1636ab', 'fad81d52-e344-405a-b854-c48f9dab36e9', '401ca3ae-21dd-46ec-9049-08867edb84c2', '58bb7a63-fcf1-44b9-81ba-ce5b935fe363'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:43 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:43 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:44 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.259s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:44 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:44 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Deleted volume successfully. Aug 28 20:26:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1f6f4b27-4b97-466a-b0f3-f1759e50f4b6 tempest-CreateVolumesFromSnapshotTest-1179890664 None] Lock "cinder-17b23d02-bd9a-4aaa-8435-b26a75e7b98a-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Flow 'volume_create_manager' (ca7d58a7-f305-45e3-ace0-d65f82e68b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f05597-763c-442e-971e-bf3b927216c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f05597-763c-442e-971e-bf3b927216c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e5da50-a2e9-4757-a873-2cb2cf61fb99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30de2dc43b449d8952cceea88fe3700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:47Z,use_quota=True,user_id='3b26dae7ffcf4920861b3a88cfca22d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5775be-e074-4edf-bac7-cac7e1222176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5775be-e074-4edf-bac7-cac7e1222176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391a8604-eba3-4b97-955f-0edfbce1f3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391a8604-eba3-4b97-955f-0edfbce1f3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e5da50-a2e9-4757-a873-2cb2cf61fb99', 'volume_name': 'volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edebe559-2930-48d9-bf6b-2b9ad66e85c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edebe559-2930-48d9-bf6b-2b9ad66e85c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4e8163-83ad-4495-b597-db3a7b888848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:46 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Volume 39e5da50-a2e9-4757-a873-2cb2cf61fb99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99', 'volume_size': 1} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e5da50-a2e9-4757-a873-2cb2cf61fb99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30de2dc43b449d8952cceea88fe3700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:47Z,use_quota=True,user_id='3b26dae7ffcf4920861b3a88cfca22d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Creating volume 39e5da50-a2e9-4757-a873-2cb2cf61fb99 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:26:46 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:26:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:46 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99 1073741824 Aug 28 20:26:46 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:47 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99 1073741824" returned: 0 in 0.410s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:47 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99 Aug 28 20:26:47 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:47 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99" returned: 0 in 0.263s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:26:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4e8163-83ad-4495-b597-db3a7b888848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac355b7-9dae-4327-b355-ae3969f789fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:47 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Volume volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99 (39e5da50-a2e9-4757-a873-2cb2cf61fb99): created successfully Aug 28 20:26:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac355b7-9dae-4327-b355-ae3969f789fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Flow 'volume_create_manager' (ca7d58a7-f305-45e3-ace0-d65f82e68b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:47 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7e230260-9def-4e6b-97ae-4cafd3645d4b tempest-CinderUnicodeTest-1836715857 None] Created volume successfully. Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Flow 'volume_create_manager' (406c110c-5c43-4467-ba8d-14c4c71a2b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502c26d0-d02a-408f-93dd-faf336eace3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502c26d0-d02a-408f-93dd-faf336eace3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-662740953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc05fdde-73fe-4d94-b069-8e3f128e8385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30de2dc43b449d8952cceea88fe3700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:48Z,use_quota=True,user_id='3b26dae7ffcf4920861b3a88cfca22d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5ea633-ebf9-482a-8421-7c561c01e618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5ea633-ebf9-482a-8421-7c561c01e618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bedb4f-f7f5-400a-90df-d8cda8c3b1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bedb4f-f7f5-400a-90df-d8cda8c3b1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc05fdde-73fe-4d94-b069-8e3f128e8385', 'volume_name': 'volume-dc05fdde-73fe-4d94-b069-8e3f128e8385', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2676979-646b-4c5d-ae50-658c4969c9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2676979-646b-4c5d-ae50-658c4969c9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a872d123-2863-43d5-8688-9378b377dbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:48 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Volume dc05fdde-73fe-4d94-b069-8e3f128e8385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc05fdde-73fe-4d94-b069-8e3f128e8385', 'volume_size': 1} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:26:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-662740953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc05fdde-73fe-4d94-b069-8e3f128e8385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30de2dc43b449d8952cceea88fe3700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:26:48Z,use_quota=True,user_id='3b26dae7ffcf4920861b3a88cfca22d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Creating volume dc05fdde-73fe-4d94-b069-8e3f128e8385 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:26:48 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:26:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:48 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 1073741824 Aug 28 20:26:48 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:49 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 1073741824" returned: 0 in 0.515s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:49 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 Aug 28 20:26:49 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:49 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:26:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a872d123-2863-43d5-8688-9378b377dbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc05fdde-73fe-4d94-b069-8e3f128e8385', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4bfcd6-fd13-494a-ba67-f1e750b4c5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:26:49 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Volume volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 (dc05fdde-73fe-4d94-b069-8e3f128e8385): created successfully Aug 28 20:26:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4bfcd6-fd13-494a-ba67-f1e750b4c5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:26:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Flow 'volume_create_manager' (406c110c-5c43-4467-ba8d-14c4c71a2b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:26:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-e1561f24-4000-4c00-95f8-7a23d3cacc44 tempest-CinderUnicodeTest-1836715857 None] Created volume successfully. Aug 28 20:26:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Creating offline snapshot 9358b4e3-2368-4acc-bdd0-f92e716905da of volume dc05fdde-73fe-4d94-b069-8e3f128e8385 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:26:50 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca037aa-6bd9-4c5c-8afa-781a7d2de0af]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:50 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 Aug 28 20:26:50 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:51 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385" returned: 0 in 0.374s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:51 devstack sudo[102122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da 1G Aug 28 20:26:51 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:51 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da 1G" returned: 0 in 0.429s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:51 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da Aug 28 20:26:51 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:51 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da" returned: 0 in 0.308s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:51 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da is being set with open permissions: ugo+rw Aug 28 20:26:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:51 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da Aug 28 20:26:51 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:52 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da" returned: 0 in 0.241s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:52 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.info Aug 28 20:26:52 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:52 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.info" returned: 0 in 0.277s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:52 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.info is being set with open permissions: ugo+rw Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:52 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.info Aug 28 20:26:52 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:52 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.info" returned: 0 in 0.238s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a3621e38-8881-4549-8c72-5877e9b435c5 tempest-CinderUnicodeTest-1836715857 None] Create snapshot completed successfully Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "cinder-9358b4e3-2368-4acc-bdd0-f92e716905da-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-9358b4e3-2368-4acc-bdd0-f92e716905da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "cinder-quobyte-dc05fdde-73fe-4d94-b069-8e3f128e8385" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-quobyte-dc05fdde-73fe-4d94-b069-8e3f128e8385" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "cinder-quobyte-9358b4e3-2368-4acc-bdd0-f92e716905da" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-quobyte-9358b4e3-2368-4acc-bdd0-f92e716905da" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Deleting offline snapshot 9358b4e3-2368-4acc-bdd0-f92e716905da of volume dc05fdde-73fe-4d94-b069-8e3f128e8385 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] snapshot_file for this snap is: volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f122cf-0718-4929-99fa-8997497bbee6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:53 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da Aug 28 20:26:53 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:53 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da" returned: 0 in 0.382s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc05fdde-73fe-4d94-b069-8e3f128e8385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:26:53 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eacd4c-e1db-4b57-a084-47ef90735c4c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:53 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 Aug 28 20:26:53 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:53 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385" returned: 0 in 0.366s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:53 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da Aug 28 20:26:53 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:54 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da" returned: 0 in 0.345s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:54 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da Aug 28 20:26:54 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:54 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385.9358b4e3-2368-4acc-bdd0-f92e716905da" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-quobyte-9358b4e3-2368-4acc-bdd0-f92e716905da" released by "_delete_snapshot" :: held 1.462s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-quobyte-dc05fdde-73fe-4d94-b069-8e3f128e8385" released by "delete_snapshot" :: held 1.484s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:54 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Created reservations ['f0523fba-7fe2-42c5-9ff6-1db3746a392e', '5b9f0b12-6e21-4426-b1ff-8bcdfb946052', '76d30d40-4ff2-4440-9152-ea8909485cc4', '29593f2d-ba29-46c1-be47-0b4fc626e7e0'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Delete snapshot completed successfully. Aug 28 20:26:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b43accff-b45c-42f4-be39-ea0b18dbc1b4 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-9358b4e3-2368-4acc-bdd0-f92e716905da-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "cinder-dc05fdde-73fe-4d94-b069-8e3f128e8385-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-dc05fdde-73fe-4d94-b069-8e3f128e8385-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "cinder-quobyte-dc05fdde-73fe-4d94-b069-8e3f128e8385" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-quobyte-dc05fdde-73fe-4d94-b069-8e3f128e8385" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afa12d2-e4ef-4d24-b128-c31adfe56a9d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:55 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 Aug 28 20:26:55 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:55 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385" returned: 0 in 0.502s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:55 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385 Aug 28 20:26:55 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:55 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dc05fdde-73fe-4d94-b069-8e3f128e8385" returned: 0 in 0.251s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-quobyte-dc05fdde-73fe-4d94-b069-8e3f128e8385" released by "delete_volume" :: held 0.809s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:55 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Created reservations ['3b61349b-e34f-458b-aade-e5f832715506', '0aa663fb-0979-490d-b9fe-2a5f422ba884', '0f4ccceb-271e-4c03-b30e-c74db8d9fa97', '02062358-fe0f-4bc2-a161-2fd312507ee9'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:56 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:56 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "cinder-39e5da50-a2e9-4757-a873-2cb2cf61fb99-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-39e5da50-a2e9-4757-a873-2cb2cf61fb99-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "cinder-quobyte-39e5da50-a2e9-4757-a873-2cb2cf61fb99" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-quobyte-39e5da50-a2e9-4757-a873-2cb2cf61fb99" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:26:56 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.293s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:56 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Deleted volume successfully. Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ffba52-5c63-41d2-afa5-1f810260cbfc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-779dfd8f-bf65-4e06-a1ae-40d86d039dd8 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-dc05fdde-73fe-4d94-b069-8e3f128e8385-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:56 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99 Aug 28 20:26:56 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:56 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99" returned: 0 in 0.372s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:56 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99 Aug 28 20:26:56 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:56 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-39e5da50-a2e9-4757-a873-2cb2cf61fb99" returned: 0 in 0.256s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-quobyte-39e5da50-a2e9-4757-a873-2cb2cf61fb99" released by "delete_volume" :: held 0.677s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Created reservations ['7ea9808b-b601-418d-8d87-3073529848ba', '0434a663-299f-45b3-84ca-fa9de02c8d74', '7c6ba958-66ee-4f21-8b2f-b05a2ff44aeb', '33f134c3-b6ca-44e8-86fb-d3427c4576b3'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:26:57 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:26:57 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:26:57 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.283s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:26:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Deleted volume successfully. Aug 28 20:26:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-26b0126e-1e45-4ef3-aad4-dca38b79ebc5 tempest-CinderUnicodeTest-1836715857 None] Lock "cinder-39e5da50-a2e9-4757-a873-2cb2cf61fb99-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:27:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:27:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:27:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:27:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:27:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:27:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:27:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:27:06 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:27:06 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:27:07 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Aug 28 20:27:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.238s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:27:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:27:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:27:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:27:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:27:07 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=111,cinder:INSERT=43,cinder:UPDATE=130,cinder:DELETE=13 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:27:07 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=137,cinder:SELECT=113,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Flow 'volume_create_manager' (2d075412-fb04-4f55-a03b-30592176160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decdf0b6-fbe7-44a0-9224-9a8fb5962f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (decdf0b6-fbe7-44a0-9224-9a8fb5962f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-878164361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd48a25e-5a75-435f-b65e-c8aeff77f9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9520d508761744c69a2f426ae78034b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:27:14Z,use_quota=True,user_id='51f0aa20b28e48fa9e299edd051b2cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbd5d71-ec71-45d5-b6cf-ed5e2929ade5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbd5d71-ec71-45d5-b6cf-ed5e2929ade5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e153e44e-2fe6-4c05-ae87-412feea22b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.image.glance [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Creating Keystone auth plugin from conf {{(pid=86028) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e153e44e-2fe6-4c05-ae87-412feea22b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd48a25e-5a75-435f-b65e-c8aeff77f9e3', 'volume_name': 'volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348fb3d3-f1af-4484-bf92-796372eae025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348fb3d3-f1af-4484-bf92-796372eae025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b487eba5-ff41-470e-9ee0-528815863c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:27:14 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Volume dd48a25e-5a75-435f-b65e-c8aeff77f9e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Trying to clone dd48a25e-5a75-435f-b65e-c8aeff77f9e3 from image b69357c8-f1c6-42fd-802c-792fbb69d92d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]). {{(pid=86028) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 20:27:14 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Image download 20.69 MB at 20.69 MB/s Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b490577-1700-45e2-b686-954c249209d4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:27:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:27:14 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD Aug 28 20:27:14 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:27:15 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Temporary image b69357c8-f1c6-42fd-802c-792fbb69d92d is fetched for user 51f0aa20b28e48fa9e299edd051b2cc1. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e216589f-7efa-4f12-bf78-f7c783109a1a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:27:15 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD Aug 28 20:27:15 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:27:15 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-878164361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd48a25e-5a75-435f-b65e-c8aeff77f9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9520d508761744c69a2f426ae78034b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:27:14Z,use_quota=True,user_id='51f0aa20b28e48fa9e299edd051b2cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Creating volume dd48a25e-5a75-435f-b65e-c8aeff77f9e3 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:27:15 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:27:15 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 1073741824 Aug 28 20:27:15 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:27:15 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 1073741824" returned: 0 in 0.394s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:27:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:27:15 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 Aug 28 20:27:15 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:27:16 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Attempting download of b69357c8-f1c6-42fd-802c-792fbb69d92d ((None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}])) to volume dd48a25e-5a75-435f-b65e-c8aeff77f9e3. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec34688-54ae-4853-adf1-4a19231fb78d]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_d__a4twm {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:27:16 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_d__a4twm Aug 28 20:27:16 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:27:16 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_d__a4twm" returned: 0 in 0.315s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_d__a4twm {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:27:16 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_d__a4twm Aug 28 20:27:16 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:27:16 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_d__a4twm" returned: 1 in 0.322s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b69357c8-f1c6-42fd-802c-792fbb69d92d_d__a4twm' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f17d218-83bf-4b19-ab0b-8d50599527ba]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:27:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:27:17 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD Aug 28 20:27:17 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:27:17 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Aug 28 20:27:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:27:17 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] b69357c8-f1c6-42fd-802c-792fbb69d92d was qcow2, converting to qcow2 {{(pid=86028) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 20:27:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:27:17 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 Aug 28 20:27:17 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:27:18 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Aug 28 20:27:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3" returned: 0 in 1.532s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:27:18 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b69357c8-f1c6-42fd-802c-792fbb69d92d_0hunao_vdevstack@QuobyteHD, size 112.00 MB, duration 1.53 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:27:18 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Converted 112.00 MB image at 72.99 MB/s Aug 28 20:27:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:27:18 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 1G Aug 28 20:27:18 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:27:19 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Aug 28 20:27:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 1G" returned: 0 in 0.305s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:27:19 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Downloaded image b69357c8-f1c6-42fd-802c-792fbb69d92d ((None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}])) to volume dd48a25e-5a75-435f-b65e-c8aeff77f9e3 successfully. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 20:27:19 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Temporary image b69357c8-f1c6-42fd-802c-792fbb69d92d for user 51f0aa20b28e48fa9e299edd051b2cc1 is deleted. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 20:27:19 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Marking volume dd48a25e-5a75-435f-b65e-c8aeff77f9e3 as bootable. {{(pid=86028) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 20:27:19 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Copying metadata from image b69357c8-f1c6-42fd-802c-792fbb69d92d to dd48a25e-5a75-435f-b65e-c8aeff77f9e3. {{(pid=86028) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 20:27:19 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Creating volume glance metadata for volume dd48a25e-5a75-435f-b65e-c8aeff77f9e3 backed by image b69357c8-f1c6-42fd-802c-792fbb69d92d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86028) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 20:27:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b487eba5-ff41-470e-9ee0-528815863c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3', 'volume_size': 1, 'image_id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b69357c8-f1c6-42fd-802c-792fbb69d92d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de8ddfde01374e00a79cb14fb7c6107a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b69357c8-f1c6-42fd-802c-792fbb69d92d', 'created_at': datetime.datetime(2026, 8, 28, 18, 5, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 5, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b69357c8-f1c6-42fd-802c-792fbb69d92d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:27:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2716374a-6536-4d31-9eec-06149bff85ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:27:19 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Volume volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 (dd48a25e-5a75-435f-b65e-c8aeff77f9e3): created successfully Aug 28 20:27:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2716374a-6536-4d31-9eec-06149bff85ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:27:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Flow 'volume_create_manager' (2d075412-fb04-4f55-a03b-30592176160f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:27:19 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a5f2dadb-015b-4494-83ef-ce26addeee17 tempest-TestShelveInstance-1256997198 None] Created volume successfully. Aug 28 20:27:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-32f473de-c7d7-4029-9c2a-0d8a3fe06377 req-a5a636f2-daf9-4a02-b5cc-dc22a8d8b8e4 tempest-TestShelveInstance-1256997198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:27:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-32f473de-c7d7-4029-9c2a-0d8a3fe06377 req-a5a636f2-daf9-4a02-b5cc-dc22a8d8b8e4 tempest-TestShelveInstance-1256997198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:27:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-32f473de-c7d7-4029-9c2a-0d8a3fe06377 req-a5a636f2-daf9-4a02-b5cc-dc22a8d8b8e4 tempest-TestShelveInstance-1256997198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:27:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-32f473de-c7d7-4029-9c2a-0d8a3fe06377 req-a5a636f2-daf9-4a02-b5cc-dc22a8d8b8e4 tempest-TestShelveInstance-1256997198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f58e1f87-6f7c-4fcb-ae30-e022017bc309', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:27:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-32f473de-c7d7-4029-9c2a-0d8a3fe06377 req-a5a636f2-daf9-4a02-b5cc-dc22a8d8b8e4 tempest-TestShelveInstance-1256997198 None] attachment_update completed successfully. Aug 28 20:27:31 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=8,cinder:SELECT=17,cinder:INSERT=3 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:27:31 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=15,cinder:INSERT=11,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:27:50 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:27:50 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:27:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-fb209082-cae2-42d5-aeb3-221162770770 req-5ff12598-c8a9-4b22-a0ff-041425a80280 tempest-TestShelveInstance-1256997198 None] Terminate volume connection completed successfully. Aug 28 20:27:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-fb209082-cae2-42d5-aeb3-221162770770 req-5ff12598-c8a9-4b22-a0ff-041425a80280 tempest-TestShelveInstance-1256997198 None] Deleting attachment f58e1f87-6f7c-4fcb-ae30-e022017bc309. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:27:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-816f5c9b-869b-44d8-8d3a-dc06e7deb35b req-23c6ba47-a307-4bb9-901b-e70a6b1bf807 tempest-TestShelveInstance-1256997198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:27:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-816f5c9b-869b-44d8-8d3a-dc06e7deb35b req-23c6ba47-a307-4bb9-901b-e70a6b1bf807 tempest-TestShelveInstance-1256997198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:27:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-816f5c9b-869b-44d8-8d3a-dc06e7deb35b req-23c6ba47-a307-4bb9-901b-e70a6b1bf807 tempest-TestShelveInstance-1256997198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:27:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-816f5c9b-869b-44d8-8d3a-dc06e7deb35b req-23c6ba47-a307-4bb9-901b-e70a6b1bf807 tempest-TestShelveInstance-1256997198 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838', 'name': 'volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52380d56-558c-4a46-8e81-547b00119d3c', 'enforce_multipath': True} {{(pid=86028) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 28 20:27:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-816f5c9b-869b-44d8-8d3a-dc06e7deb35b req-23c6ba47-a307-4bb9-901b-e70a6b1bf807 tempest-TestShelveInstance-1256997198 None] attachment_update completed successfully. Aug 28 20:28:05 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:28:05 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:28:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:28:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:28:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:28:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:06 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:28:06 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:07 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.271s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:28:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:28:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:28:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:28:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-2869e956-1e27-4b7c-af14-7d722c078110 tempest-TestShelveInstance-1256997198 None] Terminate volume connection completed successfully. Aug 28 20:28:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-2869e956-1e27-4b7c-af14-7d722c078110 tempest-TestShelveInstance-1256997198 None] Deleting attachment 52380d56-558c-4a46-8e81-547b00119d3c. {{(pid=86028) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 28 20:28:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Acquiring lock "cinder-dd48a25e-5a75-435f-b65e-c8aeff77f9e3-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:28:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Lock "cinder-dd48a25e-5a75-435f-b65e-c8aeff77f9e3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:28:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Acquiring lock "cinder-quobyte-dd48a25e-5a75-435f-b65e-c8aeff77f9e3" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:28:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Lock "cinder-quobyte-dd48a25e-5a75-435f-b65e-c8aeff77f9e3" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:28:38 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[83944d5f-4fac-4a74-a785-31cc7579b037]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:28:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:39 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 Aug 28 20:28:39 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:39 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3" returned: 0 in 0.376s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:39 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3 Aug 28 20:28:39 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:39 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-dd48a25e-5a75-435f-b65e-c8aeff77f9e3" returned: 0 in 0.249s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Lock "cinder-quobyte-dd48a25e-5a75-435f-b65e-c8aeff77f9e3" released by "delete_volume" :: held 0.671s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG cinder.quota [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Created reservations ['9da58693-42ab-420a-8b0f-945ead96c374', 'aa4edf0d-1610-4192-bd65-e4323488e710', '65f82483-2513-4cba-8921-2ce4e42cd16e', '3aaf7488-26f9-4494-baf9-94a764068989'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:39 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:28:39 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:39 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.248s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG cinder.manager [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:28:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Deleted volume successfully. Aug 28 20:28:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [req-52077f22-fe95-4700-9d73-2ef337d71d45 req-fa25f1ed-9660-401b-9e7d-fa58079bcdad tempest-TestShelveInstance-1256997198 None] Lock "cinder-dd48a25e-5a75-435f-b65e-c8aeff77f9e3-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:28:49 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:28:49 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Flow 'volume_create_manager' (4f0ff8c5-2f52-4c21-b45f-44b2075d7da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729c62e9-9a76-4a9f-9b70-5a8618f86722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729c62e9-9a76-4a9f-9b70-5a8618f86722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1963603977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d682e6-d3eb-46cf-8e61-f847402bfe2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2efc8c355476ba00c4471deb76d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:28:51Z,use_quota=True,user_id='8e4f0767fa66458790f33e6e1d58d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60a661e-430e-4863-96b3-7e3c43b67d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60a661e-430e-4863-96b3-7e3c43b67d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f85337-7d7c-46a7-8022-8ba042985a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f85337-7d7c-46a7-8022-8ba042985a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d682e6-d3eb-46cf-8e61-f847402bfe2d', 'volume_name': 'volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d345d6d3-f432-4a2b-ab3d-543eae30dcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d345d6d3-f432-4a2b-ab3d-543eae30dcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc0abb9-c43c-46ac-9a5c-5192df5d0b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:51 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Volume f5d682e6-d3eb-46cf-8e61-f847402bfe2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d', 'volume_size': 1} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1963603977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d682e6-d3eb-46cf-8e61-f847402bfe2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2efc8c355476ba00c4471deb76d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:28:51Z,use_quota=True,user_id='8e4f0767fa66458790f33e6e1d58d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Creating volume f5d682e6-d3eb-46cf-8e61-f847402bfe2d {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:28:51 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:51 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d 1073741824 Aug 28 20:28:51 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Flow 'volume_create_manager' (c26f00f4-73be-4bdf-ad22-24c41a793786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2aa6e25-6779-4392-bc57-404e56083dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2aa6e25-6779-4392-bc57-404e56083dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1795364312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966f6137-ea3f-4acc-90c8-2935df62b277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2efc8c355476ba00c4471deb76d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:28:52Z,use_quota=True,user_id='8e4f0767fa66458790f33e6e1d58d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcad637c-3c67-47ca-bfc4-b1e553b4b3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcad637c-3c67-47ca-bfc4-b1e553b4b3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c7b64d-db60-42e1-94aa-609de063bcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c7b64d-db60-42e1-94aa-609de063bcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966f6137-ea3f-4acc-90c8-2935df62b277', 'volume_name': 'volume-966f6137-ea3f-4acc-90c8-2935df62b277', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd2ae54-ee6c-4165-8e7e-3be557f94383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd2ae54-ee6c-4165-8e7e-3be557f94383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe10235f-1110-4d5a-8ab2-a46942456f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:51 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Volume 966f6137-ea3f-4acc-90c8-2935df62b277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966f6137-ea3f-4acc-90c8-2935df62b277', 'volume_size': 1} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:51 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d 1073741824" returned: 0 in 0.519s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:51 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d Aug 28 20:28:51 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:51 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Flow 'volume_create_manager' (48634f74-69a1-472d-9f89-24daf99ed6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21cd21c9-83a4-4259-a441-acfeabbcbb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21cd21c9-83a4-4259-a441-acfeabbcbb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-678878524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52e9429-dea2-4e8e-896c-80292d59fa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2efc8c355476ba00c4471deb76d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:28:52Z,use_quota=True,user_id='8e4f0767fa66458790f33e6e1d58d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925ef7cf-a530-42cb-91d7-f95f74a532af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925ef7cf-a530-42cb-91d7-f95f74a532af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede5630a-ce81-447c-a849-6bb77535abe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede5630a-ce81-447c-a849-6bb77535abe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52e9429-dea2-4e8e-896c-80292d59fa29', 'volume_name': 'volume-e52e9429-dea2-4e8e-896c-80292d59fa29', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782da669-6a6b-4d29-b5a9-4ecf8f828b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782da669-6a6b-4d29-b5a9-4ecf8f828b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61aed355-3950-40c3-8a8d-a4389f6e04d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Volume e52e9429-dea2-4e8e-896c-80292d59fa29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52e9429-dea2-4e8e-896c-80292d59fa29', 'volume_size': 1} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:52 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d" returned: 0 in 0.265s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1795364312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966f6137-ea3f-4acc-90c8-2935df62b277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2efc8c355476ba00c4471deb76d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:28:52Z,use_quota=True,user_id='8e4f0767fa66458790f33e6e1d58d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Creating volume 966f6137-ea3f-4acc-90c8-2935df62b277 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:28:52 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc0abb9-c43c-46ac-9a5c-5192df5d0b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84cb149-4ce6-4472-ba74-38c5a5e8d1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277 1073741824 Aug 28 20:28:52 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Volume volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d (f5d682e6-d3eb-46cf-8e61-f847402bfe2d): created successfully Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84cb149-4ce6-4472-ba74-38c5a5e8d1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Flow 'volume_create_manager' (4f0ff8c5-2f52-4c21-b45f-44b2075d7da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:28:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2320f513-f591-4378-b1c6-577abddc9f4d tempest-CreateVolumesFromImageTest-1637892996 None] Created volume successfully. Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Flow 'volume_create_manager' (25acdd32-247e-4d52-a709-3814aee03286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c64d5f6-ae99-4bdd-a90a-bcdf91c0f677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c64d5f6-ae99-4bdd-a90a-bcdf91c0f677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1377835929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb4077d-5f53-4d13-b940-686513846974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2efc8c355476ba00c4471deb76d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:28:52Z,use_quota=True,user_id='8e4f0767fa66458790f33e6e1d58d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a083123e-1f6f-44ee-b62f-80073b36d1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a083123e-1f6f-44ee-b62f-80073b36d1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99171553-cb44-4147-b50d-2741d2e402bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99171553-cb44-4147-b50d-2741d2e402bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb4077d-5f53-4d13-b940-686513846974', 'volume_name': 'volume-aeb4077d-5f53-4d13-b940-686513846974', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfad0c7-a443-43c8-80f1-20e1e8fe843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dfad0c7-a443-43c8-80f1-20e1e8fe843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58617056-70f5-4325-ab54-23c57cd5e848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Volume aeb4077d-5f53-4d13-b940-686513846974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb4077d-5f53-4d13-b940-686513846974', 'volume_size': 1} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:28:52 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Flow 'volume_create_manager' (773b9b65-57b2-41fd-906c-4b2a49685d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298b0e4c-8952-4bad-962f-3d065693e94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277 1073741824" returned: 0 in 0.602s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298b0e4c-8952-4bad-962f-3d065693e94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1330278777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3d54ca-501d-41c2-b2aa-bdf641ec202d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2efc8c355476ba00c4471deb76d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:28:53Z,use_quota=True,user_id='8e4f0767fa66458790f33e6e1d58d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bf2f51-0ad2-4e19-95ca-ca8a495473b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bf2f51-0ad2-4e19-95ca-ca8a495473b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2b4ec0-fcfe-4de9-bcfe-fa497021c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2b4ec0-fcfe-4de9-bcfe-fa497021c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3d54ca-501d-41c2-b2aa-bdf641ec202d', 'volume_name': 'volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2787bf-82f6-48cd-bacc-5f8b330d0141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2787bf-82f6-48cd-bacc-5f8b330d0141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7ec59f-8c18-4bcf-b71f-5db5683b7509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Volume 5c3d54ca-501d-41c2-b2aa-bdf641ec202d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d', 'volume_size': 1} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:52 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277 Aug 28 20:28:52 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:53 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277" returned: 0 in 0.250s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.037s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-678878524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52e9429-dea2-4e8e-896c-80292d59fa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2efc8c355476ba00c4471deb76d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:28:52Z,use_quota=True,user_id='8e4f0767fa66458790f33e6e1d58d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Creating volume e52e9429-dea2-4e8e-896c-80292d59fa29 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:28:53 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe10235f-1110-4d5a-8ab2-a46942456f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966f6137-ea3f-4acc-90c8-2935df62b277', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:53 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29 1073741824 Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2c8b24-ba60-4845-8e21-4c03a24311f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:53 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:53 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Volume volume-966f6137-ea3f-4acc-90c8-2935df62b277 (966f6137-ea3f-4acc-90c8-2935df62b277): created successfully Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2c8b24-ba60-4845-8e21-4c03a24311f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Flow 'volume_create_manager' (c26f00f4-73be-4bdf-ad22-24c41a793786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:28:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a2e68baa-6b95-4446-8d08-be9a59fe2bff tempest-CreateVolumesFromImageTest-1637892996 None] Created volume successfully. Aug 28 20:28:53 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29 1073741824" returned: 0 in 0.425s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:53 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29 Aug 28 20:28:53 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:53 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1377835929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb4077d-5f53-4d13-b940-686513846974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2efc8c355476ba00c4471deb76d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:28:52Z,use_quota=True,user_id='8e4f0767fa66458790f33e6e1d58d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Creating volume aeb4077d-5f53-4d13-b940-686513846974 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:28:53 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61aed355-3950-40c3-8a8d-a4389f6e04d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52e9429-dea2-4e8e-896c-80292d59fa29', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:53 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974 1073741824 Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428cc211-7573-4de3-9006-30c7eb67169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:53 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:53 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Volume volume-e52e9429-dea2-4e8e-896c-80292d59fa29 (e52e9429-dea2-4e8e-896c-80292d59fa29): created successfully Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428cc211-7573-4de3-9006-30c7eb67169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Flow 'volume_create_manager' (48634f74-69a1-472d-9f89-24daf99ed6ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:28:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0c91b241-4115-44a3-acab-b49ddcd436b0 tempest-CreateVolumesFromImageTest-1637892996 None] Created volume successfully. Aug 28 20:28:54 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974 1073741824" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:54 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974 Aug 28 20:28:54 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:54 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.709s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1330278777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3d54ca-501d-41c2-b2aa-bdf641ec202d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f2efc8c355476ba00c4471deb76d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:28:53Z,use_quota=True,user_id='8e4f0767fa66458790f33e6e1d58d57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Creating volume 5c3d54ca-501d-41c2-b2aa-bdf641ec202d {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:28:54 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:54 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d 1073741824 Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58617056-70f5-4325-ab54-23c57cd5e848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb4077d-5f53-4d13-b940-686513846974', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:54 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee330d10-7b9a-4283-a383-7ca7b5dddd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:54 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Volume volume-aeb4077d-5f53-4d13-b940-686513846974 (aeb4077d-5f53-4d13-b940-686513846974): created successfully Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee330d10-7b9a-4283-a383-7ca7b5dddd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Flow 'volume_create_manager' (25acdd32-247e-4d52-a709-3814aee03286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:28:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c8157cfa-05dc-43ff-af2e-bdbd3a3e933d tempest-CreateVolumesFromImageTest-1637892996 None] Created volume successfully. Aug 28 20:28:54 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d 1073741824" returned: 0 in 0.403s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:54 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d Aug 28 20:28:54 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:55 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d" returned: 0 in 0.258s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:28:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7ec59f-8c18-4bcf-b71f-5db5683b7509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3958aa4-caed-467a-8c16-381fcd14eb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:28:55 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Volume volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d (5c3d54ca-501d-41c2-b2aa-bdf641ec202d): created successfully Aug 28 20:28:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3958aa4-caed-467a-8c16-381fcd14eb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:28:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Flow 'volume_create_manager' (773b9b65-57b2-41fd-906c-4b2a49685d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:28:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3bd2c99d-1e63-47ad-9e76-0b93f3cee434 tempest-CreateVolumesFromImageTest-1637892996 None] Created volume successfully. Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "cinder-5c3d54ca-501d-41c2-b2aa-bdf641ec202d-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-5c3d54ca-501d-41c2-b2aa-bdf641ec202d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "cinder-quobyte-5c3d54ca-501d-41c2-b2aa-bdf641ec202d" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-quobyte-5c3d54ca-501d-41c2-b2aa-bdf641ec202d" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29da76d-7ede-4acc-a90f-7e94648325b7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:56 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d Aug 28 20:28:56 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:56 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d" returned: 0 in 0.344s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:56 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d Aug 28 20:28:56 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:56 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5c3d54ca-501d-41c2-b2aa-bdf641ec202d" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-quobyte-5c3d54ca-501d-41c2-b2aa-bdf641ec202d" released by "delete_volume" :: held 0.622s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Created reservations ['8d7b803b-cc02-4ff8-8c09-5bafd77696fb', '5ac77008-adc9-44e0-93db-90919cf4967c', 'e426de4e-feb7-42f6-8f89-b9e55d1e385a', 'f5b734a3-1c77-4d58-8473-3e33073a741c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:56 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:28:56 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:57 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.249s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:28:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Deleted volume successfully. Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6fb7169e-2eb5-4864-ab9d-c7dbe3c7015f tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-5c3d54ca-501d-41c2-b2aa-bdf641ec202d-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "cinder-aeb4077d-5f53-4d13-b940-686513846974-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-aeb4077d-5f53-4d13-b940-686513846974-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "cinder-quobyte-aeb4077d-5f53-4d13-b940-686513846974" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-quobyte-aeb4077d-5f53-4d13-b940-686513846974" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0226cb1f-0c96-401b-bf7b-5b66e255165e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:57 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974 Aug 28 20:28:57 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:57 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974" returned: 0 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:57 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974 Aug 28 20:28:57 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:57 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-aeb4077d-5f53-4d13-b940-686513846974" returned: 0 in 0.236s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-quobyte-aeb4077d-5f53-4d13-b940-686513846974" released by "delete_volume" :: held 0.618s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Created reservations ['6d5ccd90-7d6e-43be-a996-445b2614f6f6', 'bf77ca5c-ffd3-4bdd-abfe-4670be82b34c', '6c89ac2c-9b58-4fb7-a1d1-250576131a41', 'dca8a4a7-c473-487d-8ed1-d5343e5a7338'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:58 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:28:58 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:58 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.248s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:28:58 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Deleted volume successfully. Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0e3c5574-82c3-43c8-957f-b5b9a37e56e9 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-aeb4077d-5f53-4d13-b940-686513846974-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "cinder-e52e9429-dea2-4e8e-896c-80292d59fa29-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-e52e9429-dea2-4e8e-896c-80292d59fa29-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "cinder-quobyte-e52e9429-dea2-4e8e-896c-80292d59fa29" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-quobyte-e52e9429-dea2-4e8e-896c-80292d59fa29" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdd9661-c26a-4238-99ea-585ef284e718]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:58 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29 Aug 28 20:28:58 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:58 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29" returned: 0 in 0.367s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:58 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29 Aug 28 20:28:58 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:59 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e52e9429-dea2-4e8e-896c-80292d59fa29" returned: 0 in 0.240s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-quobyte-e52e9429-dea2-4e8e-896c-80292d59fa29" released by "delete_volume" :: held 0.646s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Created reservations ['d561d8a7-2a65-45b0-8f8e-a5d2b211e756', 'ee675dd9-a4a7-431e-a71f-0babbf564568', 'dd26445c-0c24-414f-98b2-7f25c0015d7d', '2d8ea727-8a72-4d57-b2c3-468ecf1fef0d'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:59 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:28:59 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:59 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.237s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:28:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Deleted volume successfully. Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-143794c9-2e52-4c24-be38-ab9668022aa8 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-e52e9429-dea2-4e8e-896c-80292d59fa29-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "cinder-966f6137-ea3f-4acc-90c8-2935df62b277-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-966f6137-ea3f-4acc-90c8-2935df62b277-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "cinder-quobyte-966f6137-ea3f-4acc-90c8-2935df62b277" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-quobyte-966f6137-ea3f-4acc-90c8-2935df62b277" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9559a0c7-0517-4d3d-bfa2-b26d5faed9ae]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:59 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277 Aug 28 20:28:59 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:28:59 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277" returned: 0 in 0.352s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:28:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:28:59 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277 Aug 28 20:28:59 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:00 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-966f6137-ea3f-4acc-90c8-2935df62b277" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-quobyte-966f6137-ea3f-4acc-90c8-2935df62b277" released by "delete_volume" :: held 0.628s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Created reservations ['925d1071-791b-4a62-84aa-e63c1617ee13', '667959cd-9c4a-49a0-a4d1-58bc217933b6', 'ec5b8cfe-b2e3-4f39-9b51-1dc39dc1f3f5', '98c1ba6c-65d1-472f-8163-44eaf00b3b2a'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:00 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:29:00 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:00 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.241s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:29:00 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Deleted volume successfully. Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a2c0ff8b-6ec7-4ebb-b060-9c6df08541a5 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-966f6137-ea3f-4acc-90c8-2935df62b277-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "cinder-f5d682e6-d3eb-46cf-8e61-f847402bfe2d-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-f5d682e6-d3eb-46cf-8e61-f847402bfe2d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "cinder-quobyte-f5d682e6-d3eb-46cf-8e61-f847402bfe2d" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-quobyte-f5d682e6-d3eb-46cf-8e61-f847402bfe2d" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b364c5-02d7-4adf-afe8-10e27876e10c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:00 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d Aug 28 20:29:00 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:01 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d" returned: 0 in 0.352s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:01 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d Aug 28 20:29:01 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:01 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-f5d682e6-d3eb-46cf-8e61-f847402bfe2d" returned: 0 in 0.240s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-quobyte-f5d682e6-d3eb-46cf-8e61-f847402bfe2d" released by "delete_volume" :: held 0.632s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Created reservations ['a6ad8ae3-a51b-4313-bd48-5b82d787fbce', '48ba764c-ebbb-4072-a680-2f23b8e949c0', '0c520d55-edb7-4e3c-b1f0-da7b221cf0fa', '3c6b8061-ee5e-45f2-9f61-6b8b05b26277'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:01 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:29:01 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:01 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.260s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:29:01 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Deleted volume successfully. Aug 28 20:29:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74f4b542-9e90-48cf-b5d7-7749a952f8a1 tempest-CreateVolumesFromImageTest-1637892996 None] Lock "cinder-f5d682e6-d3eb-46cf-8e61-f847402bfe2d-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Flow 'volume_create_manager' (45b9fafc-83d5-40c5-9bfb-93a9f0d1ea68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5070c508-9fcd-4f00-bcc7-ce357c4cd687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5070c508-9fcd-4f00-bcc7-ce357c4cd687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1362872484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e88e03ae31405ea3b07aa2791ec583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:29:04Z,use_quota=True,user_id='3626d98d6b0a43b8bf4e171fe87ad90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6840cd48-50b2-4ce9-8d59-d87d5f5ceb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6840cd48-50b2-4ce9-8d59-d87d5f5ceb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad2e005-39e6-4e03-9f2a-4630a6e78ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad2e005-39e6-4e03-9f2a-4630a6e78ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9', 'volume_name': 'volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef19e68-4b0c-404d-be1a-4f8248f2f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef19e68-4b0c-404d-be1a-4f8248f2f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb5fac9-299f-43cf-9c39-e05e1e4680f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:04 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Volume b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9', 'volume_size': 1} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1362872484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e88e03ae31405ea3b07aa2791ec583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:29:04Z,use_quota=True,user_id='3626d98d6b0a43b8bf4e171fe87ad90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Creating volume b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:29:04 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:04 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 1073741824 Aug 28 20:29:04 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:04 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 1073741824" returned: 0 in 0.401s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:05 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 Aug 28 20:29:05 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:05 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb5fac9-299f-43cf-9c39-e05e1e4680f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b552a1f-de81-4739-b335-8d577d813e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:05 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Volume volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 (b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9): created successfully Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b552a1f-de81-4739-b335-8d577d813e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Flow 'volume_create_manager' (45b9fafc-83d5-40c5-9bfb-93a9f0d1ea68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:29:05 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-91f50853-9222-4591-ac5e-505245ae2fe7 tempest-VolumeDependencyTests-1348930878 None] Created volume successfully. Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Creating offline snapshot 0926cbdd-c996-4496-a6bc-a7e1b68d29db of volume b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[113bc662-4b3f-4da1-a6c1-0fc3abf0e6a2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:05 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 Aug 28 20:29:05 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:05 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" returned: 0 in 0.358s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:06 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db 1G Aug 28 20:29:06 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:06 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db 1G" returned: 0 in 0.398s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:06 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db Aug 28 20:29:06 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:06 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db" returned: 0 in 0.287s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:06 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db is being set with open permissions: ugo+rw Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:06 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db Aug 28 20:29:06 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:06 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:29:06 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:06 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:06 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.info Aug 28 20:29:06 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:07 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.248s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:29:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:29:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:29:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:29:07 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.info" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:07 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.info is being set with open permissions: ugo+rw Aug 28 20:29:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:07 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.info Aug 28 20:29:07 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:07 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.info" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:07 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4a5ca5e1-d3d4-4a51-9be3-13661d412da2 tempest-VolumeDependencyTests-1348930878 None] Create snapshot completed successfully Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Flow 'volume_create_manager' (e3901cf9-df33-4087-9641-979c5f6df3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2cb7d2-5d0b-4aa4-841b-233ef61d6421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2cb7d2-5d0b-4aa4-841b-233ef61d6421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-523037581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9105871-fcb6-497d-83fb-f88414d73e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e88e03ae31405ea3b07aa2791ec583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0926cbdd-c996-4496-a6bc-a7e1b68d29db,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:29:08Z,use_quota=True,user_id='3626d98d6b0a43b8bf4e171fe87ad90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44bd176-72f7-475b-b3be-826d23350955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44bd176-72f7-475b-b3be-826d23350955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e93d11-d73d-482e-9c5a-222b9da08a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e93d11-d73d-482e-9c5a-222b9da08a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9105871-fcb6-497d-83fb-f88414d73e83', 'volume_name': 'volume-b9105871-fcb6-497d-83fb-f88414d73e83', 'volume_size': 1, 'snapshot_id': '0926cbdd-c996-4496-a6bc-a7e1b68d29db'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aa09db-38c1-4e78-bc53-f364636e52e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aa09db-38c1-4e78-bc53-f364636e52e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d2a611-92a3-4175-a591-458654d608be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:08 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Volume b9105871-fcb6-497d-83fb-f88414d73e83: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9105871-fcb6-497d-83fb-f88414d73e83', 'volume_size': 1, 'snapshot_id': '0926cbdd-c996-4496-a6bc-a7e1b68d29db'} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "cinder-quobyte-0926cbdd-c996-4496-a6bc-a7e1b68d29db-b9105871-fcb6-497d-83fb-f88414d73e83" by "_create_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-0926cbdd-c996-4496-a6bc-a7e1b68d29db-b9105871-fcb6-497d-83fb-f88414d73e83" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Creating volume b9105871-fcb6-497d-83fb-f88414d73e83 from snapshot 0926cbdd-c996-4496-a6bc-a7e1b68d29db {{(pid=86028) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "cinder-quobyte-b9105871-fcb6-497d-83fb-f88414d73e83" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-b9105871-fcb6-497d-83fb-f88414d73e83" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] snapshot: 0926cbdd-c996-4496-a6bc-a7e1b68d29db, volume: b9105871-fcb6-497d-83fb-f88414d73e83, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[46baf6e2-8e0f-4a71-bbf2-6b6fe15e9422]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:08 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db Aug 28 20:29:08 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:08 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db" returned: 0 in 0.353s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77bc27b-8578-4341-9f9c-4f8dde7b023a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:08 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 Aug 28 20:29:08 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:09 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" returned: 0 in 0.350s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:29:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:29:09 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:29:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:09 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 Aug 28 20:29:09 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:13 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83" returned: 0 in 3.979s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9, size 1024.00 MB, duration 3.98 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:29:13 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Converted 1024.00 MB image at 257.28 MB/s Aug 28 20:29:13 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 is being set with open permissions: ugo+rw Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:13 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 Aug 28 20:29:13 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:13 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83" returned: 0 in 0.231s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-b9105871-fcb6-497d-83fb-f88414d73e83" released by "_copy_volume_from_snapshot" :: held 4.984s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-0926cbdd-c996-4496-a6bc-a7e1b68d29db-b9105871-fcb6-497d-83fb-f88414d73e83" released by "_create_volume_from_snapshot" :: held 5.043s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.058s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d2a611-92a3-4175-a591-458654d608be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9105871-fcb6-497d-83fb-f88414d73e83', 'volume_size': 1, 'snapshot_id': '0926cbdd-c996-4496-a6bc-a7e1b68d29db'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9c6720-e0a6-4c20-b4c3-ef9eedb67f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:13 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Volume volume-b9105871-fcb6-497d-83fb-f88414d73e83 (b9105871-fcb6-497d-83fb-f88414d73e83): created successfully Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9c6720-e0a6-4c20-b4c3-ef9eedb67f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Flow 'volume_create_manager' (e3901cf9-df33-4087-9641-979c5f6df3e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:29:13 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-be25526f-449b-48b4-a9e6-941d0dfee50c tempest-VolumeDependencyTests-1348930878 None] Created volume successfully. Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "cinder-0926cbdd-c996-4496-a6bc-a7e1b68d29db-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-0926cbdd-c996-4496-a6bc-a7e1b68d29db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "cinder-quobyte-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "cinder-quobyte-0926cbdd-c996-4496-a6bc-a7e1b68d29db" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-0926cbdd-c996-4496-a6bc-a7e1b68d29db" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Deleting offline snapshot 0926cbdd-c996-4496-a6bc-a7e1b68d29db of volume b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] snapshot_file for this snap is: volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e73582-2260-4ae3-9f63-31bbb4869d7a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:13 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db Aug 28 20:29:13 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:14 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db" returned: 0 in 0.349s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:29:14 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ddb18b-6b37-433b-9805-5ca746931707]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:14 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 Aug 28 20:29:14 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:14 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" returned: 0 in 0.536s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:14 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db Aug 28 20:29:14 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:14 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db" returned: 0 in 0.309s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:14 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db Aug 28 20:29:14 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:15 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9.0926cbdd-c996-4496-a6bc-a7e1b68d29db" returned: 0 in 0.235s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-0926cbdd-c996-4496-a6bc-a7e1b68d29db" released by "_delete_snapshot" :: held 1.513s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" released by "delete_snapshot" :: held 1.536s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Created reservations ['c6efb2a2-19af-4164-887d-f69cb4168258', '452b3ed2-7a59-4f82-938a-61b73755272d', '2c354efe-eab8-4bf9-99f4-df7503fc7845', '95d109fb-d75d-41b6-b954-c4350dfa849f'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:29:15 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Delete snapshot completed successfully. Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-298d6733-dc66-4f7b-9fe8-abce56bccf0b tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-0926cbdd-c996-4496-a6bc-a7e1b68d29db-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "cinder-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "cinder-quobyte-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93f025e-ad75-4853-8e56-7c0e15067a63]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:15 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 Aug 28 20:29:15 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:16 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" returned: 0 in 0.347s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:16 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9 Aug 28 20:29:16 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:16 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" returned: 0 in 0.246s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9" released by "delete_volume" :: held 0.651s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Created reservations ['2bf4f158-95b7-4dc7-99b8-cc1ab7d760cd', '54975413-9adf-4e42-99b2-50df71a03196', '67582fdf-b0e4-4bdc-82f3-9cf39f3a7763', '78575ec0-3edd-4a33-b349-04ffe2543647'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:16 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:29:16 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:16 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.235s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:29:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Deleted volume successfully. Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f2a3b210-186f-4b5a-aaeb-2c3d882d528c tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-b88cc20d-db75-4fa8-8f12-b2ff82a8dfd9-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "cinder-b9105871-fcb6-497d-83fb-f88414d73e83-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-b9105871-fcb6-497d-83fb-f88414d73e83-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "cinder-quobyte-b9105871-fcb6-497d-83fb-f88414d73e83" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-b9105871-fcb6-497d-83fb-f88414d73e83" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d247707-a480-487c-b36f-c5aefd5ba3a1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:17 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 Aug 28 20:29:17 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:17 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83" returned: 0 in 0.342s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:17 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83 Aug 28 20:29:17 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:17 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b9105871-fcb6-497d-83fb-f88414d73e83" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-quobyte-b9105871-fcb6-497d-83fb-f88414d73e83" released by "delete_volume" :: held 0.622s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Created reservations ['45b4c781-8433-4530-90f3-ab948f11f9c7', '598df10c-3a10-448b-9100-8c52e5aa9f1b', 'def7d308-a348-47d3-afff-6a8052318a22', 'e5108540-9f1f-49b2-97e2-f3cfbef3ce92'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:17 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:29:17 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:17 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.237s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:29:17 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Deleted volume successfully. Aug 28 20:29:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9da949f6-aad7-4ba7-9dca-d00d3eb7578d tempest-VolumeDependencyTests-1348930878 None] Lock "cinder-b9105871-fcb6-497d-83fb-f88414d73e83-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Flow 'volume_create_manager' (94154a86-4ba9-460b-b40a-2673352ea52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea93393d-22e4-4edf-848d-cfcd19c75bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea93393d-22e4-4edf-848d-cfcd19c75bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ae9a92-7db1-42b1-a850-a009e1bafa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bf7f475dee4a7f8eb8a2ddbeb186d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:29:23Z,use_quota=True,user_id='f6621103ea7a4b6bb56dc3ce4161c0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd899b1-1303-439d-b6ac-296ad38f0721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd899b1-1303-439d-b6ac-296ad38f0721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab738284-8ed9-41ce-b054-48aa1ee7e040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.image.glance [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Creating Keystone auth plugin from conf {{(pid=86028) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab738284-8ed9-41ce-b054-48aa1ee7e040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7ae9a92-7db1-42b1-a850-a009e1bafa10', 'volume_name': 'volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10', 'volume_size': 1, 'image_id': 'f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f44d20064179b694722578fd6cd62ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09bf7f475dee4a7f8eb8a2ddbeb186d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c193f486834e781756b2e106ef3f5ef289d06511cccadb1926ca67860819ca503f4a74bcb85b0630de8efac1421928938aa487d3d513412ba5a32a35e8de38ee', 'id': 'f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'created_at': datetime.datetime(2026, 8, 28, 18, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 29, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1bd2452-a95b-4918-94fc-c72f6cbb610a/file', 'properties': {}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edab07a5-952e-46b3-aa2a-1b4037922fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edab07a5-952e-46b3-aa2a-1b4037922fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bd38a6-4ec9-47f5-93b1-d80095deb2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:22 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Volume d7ae9a92-7db1-42b1-a850-a009e1bafa10: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10', 'volume_size': 1, 'image_id': 'f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f44d20064179b694722578fd6cd62ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09bf7f475dee4a7f8eb8a2ddbeb186d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c193f486834e781756b2e106ef3f5ef289d06511cccadb1926ca67860819ca503f4a74bcb85b0630de8efac1421928938aa487d3d513412ba5a32a35e8de38ee', 'id': 'f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'created_at': datetime.datetime(2026, 8, 28, 18, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 29, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1bd2452-a95b-4918-94fc-c72f6cbb610a/file', 'properties': {}}, 'image_service': } Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Trying to clone d7ae9a92-7db1-42b1-a850-a009e1bafa10 from image f1bd2452-a95b-4918-94fc-c72f6cbb610a at location (None, [{'url': 'file:///opt/stack/data/glance/images/f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'metadata': {}}]). {{(pid=86028) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 20:29:22 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Image download 0.00 MB at 0.00 MB/s Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[88161bc2-b4a2-4f25-8c1f-0f44a64305a8]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:23 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD Aug 28 20:29:23 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:23 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:23 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD Aug 28 20:29:23 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:23 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:29:23 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Temporary image f1bd2452-a95b-4918-94fc-c72f6cbb610a is fetched for user f6621103ea7a4b6bb56dc3ce4161c0ab. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 20:29:23 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1d0d10-93d5-41c3-afa3-36ef6cc9c804]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:23 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD Aug 28 20:29:23 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:24 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:24 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD Aug 28 20:29:24 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:24 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ae9a92-7db1-42b1-a850-a009e1bafa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bf7f475dee4a7f8eb8a2ddbeb186d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:29:23Z,use_quota=True,user_id='f6621103ea7a4b6bb56dc3ce4161c0ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Creating volume d7ae9a92-7db1-42b1-a850-a009e1bafa10 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:29:24 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:24 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 1073741824 Aug 28 20:29:24 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:24 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 1073741824" returned: 0 in 0.388s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:24 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 Aug 28 20:29:24 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:24 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10" returned: 0 in 0.235s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:29:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:25 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Attempting download of f1bd2452-a95b-4918-94fc-c72f6cbb610a ((None, [{'url': 'file:///opt/stack/data/glance/images/f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'metadata': {}}])) to volume d7ae9a92-7db1-42b1-a850-a009e1bafa10. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 20:29:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3dc38f-d3d4-42e7-9cb7-12a3bb6d5b99]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1bd2452-a95b-4918-94fc-c72f6cbb610a_o_3tdqt1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:25 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1bd2452-a95b-4918-94fc-c72f6cbb610a_o_3tdqt1 Aug 28 20:29:25 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:25 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f1bd2452-a95b-4918-94fc-c72f6cbb610a_o_3tdqt1" returned: 0 in 0.324s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1bd2452-a95b-4918-94fc-c72f6cbb610a_o_3tdqt1 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:25 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1bd2452-a95b-4918-94fc-c72f6cbb610a_o_3tdqt1 Aug 28 20:29:25 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:25 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1bd2452-a95b-4918-94fc-c72f6cbb610a_o_3tdqt1" returned: 1 in 0.316s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f1bd2452-a95b-4918-94fc-c72f6cbb610a_o_3tdqt1' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:29:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53049ea-d489-41a2-98a9-65191d064b34]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:25 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD Aug 28 20:29:25 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:26 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:26 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD Aug 28 20:29:26 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:26 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:29:26 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] f1bd2452-a95b-4918-94fc-c72f6cbb610a was raw, converting to qcow2 {{(pid=86028) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 20:29:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:26 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 Aug 28 20:29:26 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:26 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10" returned: 0 in 0.428s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:26 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f1bd2452-a95b-4918-94fc-c72f6cbb610a_35o99y_edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:29:26 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 20:29:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:26 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 1G Aug 28 20:29:26 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:27 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 1G" returned: 0 in 0.292s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Downloaded image f1bd2452-a95b-4918-94fc-c72f6cbb610a ((None, [{'url': 'file:///opt/stack/data/glance/images/f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'metadata': {}}])) to volume d7ae9a92-7db1-42b1-a850-a009e1bafa10 successfully. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Temporary image f1bd2452-a95b-4918-94fc-c72f6cbb610a for user f6621103ea7a4b6bb56dc3ce4161c0ab is deleted. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Marking volume d7ae9a92-7db1-42b1-a850-a009e1bafa10 as bootable. {{(pid=86028) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Copying metadata from image f1bd2452-a95b-4918-94fc-c72f6cbb610a to d7ae9a92-7db1-42b1-a850-a009e1bafa10. {{(pid=86028) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Creating volume glance metadata for volume d7ae9a92-7db1-42b1-a850-a009e1bafa10 backed by image f1bd2452-a95b-4918-94fc-c72f6cbb610a with: {'image_id': 'f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1f44d20064179b694722578fd6cd62ad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86028) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bd38a6-4ec9-47f5-93b1-d80095deb2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10', 'volume_size': 1, 'image_id': 'f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f44d20064179b694722578fd6cd62ad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09bf7f475dee4a7f8eb8a2ddbeb186d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c193f486834e781756b2e106ef3f5ef289d06511cccadb1926ca67860819ca503f4a74bcb85b0630de8efac1421928938aa487d3d513412ba5a32a35e8de38ee', 'id': 'f1bd2452-a95b-4918-94fc-c72f6cbb610a', 'created_at': datetime.datetime(2026, 8, 28, 18, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 29, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f1bd2452-a95b-4918-94fc-c72f6cbb610a/file', 'properties': {}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec58f62e-edb0-42ed-bccb-84bab7e5c4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:27 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Volume volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 (d7ae9a92-7db1-42b1-a850-a009e1bafa10): created successfully Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec58f62e-edb0-42ed-bccb-84bab7e5c4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Flow 'volume_create_manager' (94154a86-4ba9-460b-b40a-2673352ea52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:29:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c85800b2-c78e-4ecd-9757-255494e5f2a7 tempest-VolumeImageDependencyTests-1806355747 None] Created volume successfully. Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Acquiring lock "cinder-d7ae9a92-7db1-42b1-a850-a009e1bafa10-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Lock "cinder-d7ae9a92-7db1-42b1-a850-a009e1bafa10-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Acquiring lock "cinder-quobyte-d7ae9a92-7db1-42b1-a850-a009e1bafa10" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Lock "cinder-quobyte-d7ae9a92-7db1-42b1-a850-a009e1bafa10" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3893cc-e9cb-460f-bb73-b11a2b4bda48]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:28 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 Aug 28 20:29:28 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:28 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10" returned: 0 in 0.345s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:28 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10 Aug 28 20:29:28 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:28 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d7ae9a92-7db1-42b1-a850-a009e1bafa10" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Lock "cinder-quobyte-d7ae9a92-7db1-42b1-a850-a009e1bafa10" released by "delete_volume" :: held 0.628s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Created reservations ['964fb5d8-e4f8-4afb-93ba-ff6a7769e94c', '185f998e-0697-40fd-9fb1-e8b999fb0034', 'daeb9225-898a-4c8f-ad86-9766f68f188a', '8316d5e2-2793-4c5d-bb97-ab8359242dca'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:28 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:29:28 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:28 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.246s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:29:28 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Deleted volume successfully. Aug 28 20:29:28 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b6cb300-80d9-4951-bb50-f26e8f021b65 tempest-VolumeImageDependencyTests-1806355747 None] Lock "cinder-d7ae9a92-7db1-42b1-a850-a009e1bafa10-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Flow 'volume_create_manager' (a4a68cc7-6ef6-4044-8ba7-1ef6451c75dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5d52bc-956b-4e78-a711-c03dabd3e0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5d52bc-956b-4e78-a711-c03dabd3e0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1714227138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbd0604-e3ba-4efd-967a-0287140adcb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df1660194fc49738aa798772005d948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:29:32Z,use_quota=True,user_id='d51867d6ba504b448475c44ee8884c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc12f2d-8ba1-49a8-a053-bb478d236d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc12f2d-8ba1-49a8-a053-bb478d236d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdf9f50-5af1-4af1-9029-c58abe755944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdf9f50-5af1-4af1-9029-c58abe755944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afbd0604-e3ba-4efd-967a-0287140adcb9', 'volume_name': 'volume-afbd0604-e3ba-4efd-967a-0287140adcb9', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb3c581-747a-48ba-b87b-e65ebab6d3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb3c581-747a-48ba-b87b-e65ebab6d3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a88507-b79f-4415-830a-69213794ce48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:32 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Volume afbd0604-e3ba-4efd-967a-0287140adcb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afbd0604-e3ba-4efd-967a-0287140adcb9', 'volume_size': 1} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1714227138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbd0604-e3ba-4efd-967a-0287140adcb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df1660194fc49738aa798772005d948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:29:32Z,use_quota=True,user_id='d51867d6ba504b448475c44ee8884c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Creating volume afbd0604-e3ba-4efd-967a-0287140adcb9 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:29:32 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:32 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9 1073741824 Aug 28 20:29:32 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:32 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9 1073741824" returned: 0 in 0.402s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:33 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9 Aug 28 20:29:33 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:33 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9" returned: 0 in 0.244s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a88507-b79f-4415-830a-69213794ce48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afbd0604-e3ba-4efd-967a-0287140adcb9', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab620aa-f617-43cc-9193-59ad1ec0031f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:33 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Volume volume-afbd0604-e3ba-4efd-967a-0287140adcb9 (afbd0604-e3ba-4efd-967a-0287140adcb9): created successfully Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab620aa-f617-43cc-9193-59ad1ec0031f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Flow 'volume_create_manager' (a4a68cc7-6ef6-4044-8ba7-1ef6451c75dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:29:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-269675fa-d19d-47e1-8e0f-bce62728f782 tempest-ProjectReaderTests-1872109317 None] Created volume successfully. Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Acquiring lock "cinder-afbd0604-e3ba-4efd-967a-0287140adcb9-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Lock "cinder-afbd0604-e3ba-4efd-967a-0287140adcb9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Acquiring lock "cinder-quobyte-afbd0604-e3ba-4efd-967a-0287140adcb9" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Lock "cinder-quobyte-afbd0604-e3ba-4efd-967a-0287140adcb9" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee01c6ae-9b06-4135-be06-ca122a33f5cb]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:33 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9 Aug 28 20:29:33 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:34 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9" returned: 0 in 0.343s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:34 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9 Aug 28 20:29:34 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:34 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-afbd0604-e3ba-4efd-967a-0287140adcb9" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Lock "cinder-quobyte-afbd0604-e3ba-4efd-967a-0287140adcb9" released by "delete_volume" :: held 0.627s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Created reservations ['f65956d2-cebf-45cd-9abe-44675802599b', 'fd6d37c8-812e-4fcc-a2ab-01f078ddc5d0', 'b0e48c23-d03b-47d3-a95f-4f34312d9500', 'ce90260d-9cd7-4dc5-bde0-575789cfe541'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:34 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:29:34 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:34 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.238s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:29:34 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Deleted volume successfully. Aug 28 20:29:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d163f8c9-76d9-4aea-b5c3-73d9b0dc018a tempest-ProjectReaderTests-1872109317 None] Lock "cinder-afbd0604-e3ba-4efd-967a-0287140adcb9-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Flow 'volume_create_manager' (f7c37c19-45b2-4793-b658-82ae06997524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94323235-bcf8-4e53-8b52-8650ac80afa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94323235-bcf8-4e53-8b52-8650ac80afa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471302416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729cce3c-8d95-4d03-a266-0001ea5fe0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df1660194fc49738aa798772005d948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:29:35Z,use_quota=True,user_id='d51867d6ba504b448475c44ee8884c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b97244e-bda3-4c68-80bf-eda5258d4ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b97244e-bda3-4c68-80bf-eda5258d4ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6ff64a-d2f2-463f-9307-4c3477447082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6ff64a-d2f2-463f-9307-4c3477447082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '729cce3c-8d95-4d03-a266-0001ea5fe0eb', 'volume_name': 'volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17ef618-81ea-4e8f-ae1d-80f40bcd5ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17ef618-81ea-4e8f-ae1d-80f40bcd5ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8eec579-a338-4393-a0e7-74d535f74bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:35 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Volume 729cce3c-8d95-4d03-a266-0001ea5fe0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb', 'volume_size': 1} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471302416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729cce3c-8d95-4d03-a266-0001ea5fe0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df1660194fc49738aa798772005d948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:29:35Z,use_quota=True,user_id='d51867d6ba504b448475c44ee8884c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Creating volume 729cce3c-8d95-4d03-a266-0001ea5fe0eb {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:29:35 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:35 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb 1073741824 Aug 28 20:29:35 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:35 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb 1073741824" returned: 0 in 0.387s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:35 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb Aug 28 20:29:35 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:35 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8eec579-a338-4393-a0e7-74d535f74bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc16a80-78ad-4f21-a5c5-0ac5ec1db5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:29:35 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Volume volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb (729cce3c-8d95-4d03-a266-0001ea5fe0eb): created successfully Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cc16a80-78ad-4f21-a5c5-0ac5ec1db5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:29:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Flow 'volume_create_manager' (f7c37c19-45b2-4793-b658-82ae06997524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:29:35 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-bee69a7a-efba-494c-b4f6-558ce18e5b5b tempest-ProjectReaderTests-1872109317 None] Created volume successfully. Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Acquiring lock "cinder-729cce3c-8d95-4d03-a266-0001ea5fe0eb-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Lock "cinder-729cce3c-8d95-4d03-a266-0001ea5fe0eb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Acquiring lock "cinder-quobyte-729cce3c-8d95-4d03-a266-0001ea5fe0eb" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Lock "cinder-quobyte-729cce3c-8d95-4d03-a266-0001ea5fe0eb" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efadd14-1f28-432b-b83d-df530ef89652]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:36 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb Aug 28 20:29:36 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:36 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb" returned: 0 in 0.352s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:36 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb Aug 28 20:29:36 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:36 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-729cce3c-8d95-4d03-a266-0001ea5fe0eb" returned: 0 in 0.244s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Lock "cinder-quobyte-729cce3c-8d95-4d03-a266-0001ea5fe0eb" released by "delete_volume" :: held 0.633s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:36 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Created reservations ['b8f1dd00-d1eb-4c2b-b4e0-0c40a8d11dce', 'ac25331d-6594-4ad7-b9e0-53df04c22ff5', 'adda36c1-0f7e-4157-8438-a0a417218725', 'd5d8d924-681b-4206-ac11-26f9de22dabf'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:29:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:29:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:29:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:29:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:29:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:29:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:29:37 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:29:37 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:29:37 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Aug 28 20:29:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:29:37 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:29:37 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Deleted volume successfully. Aug 28 20:29:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57bb2ca1-c618-494c-b6d0-67c051a8e479 tempest-ProjectReaderTests-1872109317 None] Lock "cinder-729cce3c-8d95-4d03-a266-0001ea5fe0eb-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:29:50 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=90,cinder:UPDATE=121,cinder:DELETE=8,cinder:INSERT=32 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:29:50 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=83,cinder:UPDATE=117,cinder:INSERT=32,cinder:DELETE=13 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Flow 'volume_create_manager' (81e0279a-3945-4caa-aa1f-c67165320f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a97ffb-9708-450c-9dcd-3f117eb0ae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a97ffb-9708-450c-9dcd-3f117eb0ae6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1635588519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865ed1c0-5d37-4cb4-b4f8-622daee8762c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f0aacd765c493091925e997f4af2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:02Z,use_quota=True,user_id='c1adfa54addf4c8eb3d14bbefc831b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9a82f9-7dcc-4b65-999c-0d8253a4da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9a82f9-7dcc-4b65-999c-0d8253a4da4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721cbaf1-1116-4394-8543-c837b68cd1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721cbaf1-1116-4394-8543-c837b68cd1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865ed1c0-5d37-4cb4-b4f8-622daee8762c', 'volume_name': 'volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1b5abe-eff1-45b4-9eee-35926522c50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1b5abe-eff1-45b4-9eee-35926522c50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81345295-4824-45fa-9725-84fdcc3388e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:01 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Volume 865ed1c0-5d37-4cb4-b4f8-622daee8762c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c', 'volume_size': 1} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1635588519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865ed1c0-5d37-4cb4-b4f8-622daee8762c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f0aacd765c493091925e997f4af2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:02Z,use_quota=True,user_id='c1adfa54addf4c8eb3d14bbefc831b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Creating volume 865ed1c0-5d37-4cb4-b4f8-622daee8762c {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:01 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:01 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c 1073741824 Aug 28 20:30:01 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:02 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c 1073741824" returned: 0 in 0.392s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:02 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c Aug 28 20:30:02 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:02 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c" returned: 0 in 0.246s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81345295-4824-45fa-9725-84fdcc3388e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c707fd-1354-40d7-a98a-f8dd39987e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:02 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Volume volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c (865ed1c0-5d37-4cb4-b4f8-622daee8762c): created successfully Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c707fd-1354-40d7-a98a-f8dd39987e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Flow 'volume_create_manager' (81e0279a-3945-4caa-aa1f-c67165320f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4ac190ae-eb6d-4e48-a97c-04e74da1e64b tempest-SnapshotDependencyTests-80475099 None] Created volume successfully. Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Creating offline snapshot fd4d9353-7589-46b6-ad27-d7157a639c80 of volume 865ed1c0-5d37-4cb4-b4f8-622daee8762c {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5537755-6c5b-4066-99b4-c96c8043a2f9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:02 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c Aug 28 20:30:02 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:03 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c" returned: 0 in 0.343s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:03 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 1G Aug 28 20:30:03 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:03 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 1G" returned: 0 in 0.376s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:03 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 Aug 28 20:30:03 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:03 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80" returned: 0 in 0.276s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:03 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 is being set with open permissions: ugo+rw Aug 28 20:30:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:03 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 Aug 28 20:30:03 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:04 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80" returned: 0 in 0.233s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:04 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.info Aug 28 20:30:04 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:04 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.info" returned: 0 in 0.241s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:04 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.info is being set with open permissions: ugo+rw Aug 28 20:30:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:04 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.info Aug 28 20:30:04 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:04 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.info" returned: 0 in 0.231s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.779s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:04 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b0f0668b-baed-4975-8b3c-8cf7a0b047d1 tempest-SnapshotDependencyTests-80475099 None] Create snapshot completed successfully Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Flow 'volume_create_manager' (4a628d0c-a51b-4d61-b100-768a631e3f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b2a7b7-49ca-4afa-b541-5e85da910421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b2a7b7-49ca-4afa-b541-5e85da910421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826413c5-a0dc-4ae6-b67e-9ff9f668cbbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f0aacd765c493091925e997f4af2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fd4d9353-7589-46b6-ad27-d7157a639c80,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:05Z,use_quota=True,user_id='c1adfa54addf4c8eb3d14bbefc831b54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6513cb-098e-4cae-8259-5d1dbbab6082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6513cb-098e-4cae-8259-5d1dbbab6082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07025c9e-3892-42e4-9fc8-3adcbb8562df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07025c9e-3892-42e4-9fc8-3adcbb8562df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '826413c5-a0dc-4ae6-b67e-9ff9f668cbbf', 'volume_name': 'volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf', 'volume_size': 1, 'snapshot_id': 'fd4d9353-7589-46b6-ad27-d7157a639c80'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc21249b-3d6a-4132-8bd7-bdc398952e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc21249b-3d6a-4132-8bd7-bdc398952e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe1067b-b9fa-4bd8-916c-b679506f83f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:05 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Volume 826413c5-a0dc-4ae6-b67e-9ff9f668cbbf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf', 'volume_size': 1, 'snapshot_id': 'fd4d9353-7589-46b6-ad27-d7157a639c80'} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "cinder-quobyte-fd4d9353-7589-46b6-ad27-d7157a639c80-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" by "_create_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-fd4d9353-7589-46b6-ad27-d7157a639c80-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Creating volume 826413c5-a0dc-4ae6-b67e-9ff9f668cbbf from snapshot fd4d9353-7589-46b6-ad27-d7157a639c80 {{(pid=86028) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "cinder-quobyte-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] snapshot: fd4d9353-7589-46b6-ad27-d7157a639c80, volume: 826413c5-a0dc-4ae6-b67e-9ff9f668cbbf, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9175f5-0d7b-4b81-9bb5-fa3e7098e09b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:05 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 Aug 28 20:30:05 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:05 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80" returned: 0 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[42274044-7d0d-405d-ab02-9e2a97cc20fc]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:06 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c Aug 28 20:30:06 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:06 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c" returned: 0 in 0.352s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:06 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf Aug 28 20:30:06 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:07 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:07 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:07 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.642s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:30:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:30:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:30:10 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" returned: 0 in 4.015s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c, size 1024.00 MB, duration 4.02 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:30:10 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Converted 1024.00 MB image at 254.97 MB/s Aug 28 20:30:10 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf is being set with open permissions: ugo+rw Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:10 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf Aug 28 20:30:10 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:10 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" returned: 0 in 0.240s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" released by "_copy_volume_from_snapshot" :: held 5.026s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-fd4d9353-7589-46b6-ad27-d7157a639c80-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" released by "_create_volume_from_snapshot" :: held 5.084s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.098s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe1067b-b9fa-4bd8-916c-b679506f83f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf', 'volume_size': 1, 'snapshot_id': 'fd4d9353-7589-46b6-ad27-d7157a639c80'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3019185-6b56-40bb-b376-8d0de7f29f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:10 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Volume volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf (826413c5-a0dc-4ae6-b67e-9ff9f668cbbf): created successfully Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3019185-6b56-40bb-b376-8d0de7f29f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Flow 'volume_create_manager' (4a628d0c-a51b-4d61-b100-768a631e3f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:10 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-508340c6-cad7-4320-82fd-b77f4d3bc703 tempest-SnapshotDependencyTests-80475099 None] Created volume successfully. Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "cinder-fd4d9353-7589-46b6-ad27-d7157a639c80-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-fd4d9353-7589-46b6-ad27-d7157a639c80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "cinder-quobyte-865ed1c0-5d37-4cb4-b4f8-622daee8762c" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-865ed1c0-5d37-4cb4-b4f8-622daee8762c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "cinder-quobyte-fd4d9353-7589-46b6-ad27-d7157a639c80" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-fd4d9353-7589-46b6-ad27-d7157a639c80" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Deleting offline snapshot fd4d9353-7589-46b6-ad27-d7157a639c80 of volume 865ed1c0-5d37-4cb4-b4f8-622daee8762c {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] snapshot_file for this snap is: volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c056d51c-c669-4372-ac21-0049877edad6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:11 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 Aug 28 20:30:11 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:11 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80" returned: 0 in 0.355s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cccd53-3629-4a68-9ce6-574ceadf6e49]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:11 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c Aug 28 20:30:11 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:12 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c" returned: 0 in 0.514s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:12 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 Aug 28 20:30:12 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:12 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80" returned: 0 in 0.318s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:12 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80 Aug 28 20:30:12 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:12 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c.fd4d9353-7589-46b6-ad27-d7157a639c80" returned: 0 in 0.236s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-fd4d9353-7589-46b6-ad27-d7157a639c80" released by "_delete_snapshot" :: held 1.513s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-865ed1c0-5d37-4cb4-b4f8-622daee8762c" released by "delete_snapshot" :: held 1.533s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:12 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Created reservations ['b4717135-de4b-437c-a947-828ad1eaf37c', 'cb1067cb-32ea-4b39-a96c-d012b3aef02d', '8bc52040-3c03-4e4f-aae1-497c5c1b0803', 'f28c05d4-5d36-4def-8d9d-e6d4b9a3a4e1'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:12 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Delete snapshot completed successfully. Aug 28 20:30:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-94bdf3d7-cbe9-4543-8e27-69c1cc713490 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-fd4d9353-7589-46b6-ad27-d7157a639c80-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "cinder-865ed1c0-5d37-4cb4-b4f8-622daee8762c-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-865ed1c0-5d37-4cb4-b4f8-622daee8762c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "cinder-quobyte-865ed1c0-5d37-4cb4-b4f8-622daee8762c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-865ed1c0-5d37-4cb4-b4f8-622daee8762c" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a68fe9b-ea8e-4e56-89f8-2afe0a565bc4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:13 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c Aug 28 20:30:13 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:13 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c" returned: 0 in 0.350s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:13 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c Aug 28 20:30:13 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:13 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-865ed1c0-5d37-4cb4-b4f8-622daee8762c" returned: 0 in 0.241s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-865ed1c0-5d37-4cb4-b4f8-622daee8762c" released by "delete_volume" :: held 0.639s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:13 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Created reservations ['e7bc0ccd-4aac-4c73-846e-60bc694052f5', '4679c1c0-a5f9-4b87-bf71-df3b4fb5f490', 'f3ed1f09-d602-4dcf-9328-a5c03086b5a2', '3e62411c-1975-4808-a16e-a7111b393cab'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:14 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:14 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:14 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.244s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:14 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Deleted volume successfully. Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ca8f895f-661d-4d55-a112-02a6de6b7cc5 tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-865ed1c0-5d37-4cb4-b4f8-622daee8762c-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "cinder-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "cinder-quobyte-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c7c71c-3642-43b0-be94-8ab11c6355f9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:14 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf Aug 28 20:30:14 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:14 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" returned: 0 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:14 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf Aug 28 20:30:14 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:15 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" returned: 0 in 0.234s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-quobyte-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf" released by "delete_volume" :: held 0.616s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Created reservations ['b7578d74-bd30-41b5-b1a8-789bb1b265e4', '3ab8ebae-c1e3-4bd3-9056-f1312f601532', '6310ee5f-f67f-40bd-834f-238ec30b34a3', '0d2a4d26-204d-4021-9247-3dd9be40afcd'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:15 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:15 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:15 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:15 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Deleted volume successfully. Aug 28 20:30:15 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ddc69a48-8554-4859-b664-570e6fe1539a tempest-SnapshotDependencyTests-80475099 None] Lock "cinder-826413c5-a0dc-4ae6-b67e-9ff9f668cbbf-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:25 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:30:25 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=21,cinder:UPDATE=31,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (3e94d6d8-f777-48d4-b1e0-0454b38b4144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f080d29-9fb6-49bf-9880-5a3d00ce4773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f080d29-9fb6-49bf-9880-5a3d00ce4773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596433408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7e291c-d8ed-44e0-9fec-d90902f81b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:35Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a04134d-76da-4131-b499-3059ce8a2da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a04134d-76da-4131-b499-3059ce8a2da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656c9bcc-bb94-450b-a65f-15f1ccb76a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656c9bcc-bb94-450b-a65f-15f1ccb76a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c7e291c-d8ed-44e0-9fec-d90902f81b26', 'volume_name': 'volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178482a1-b0d4-49ce-aac3-8b8a09e32090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178482a1-b0d4-49ce-aac3-8b8a09e32090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb30024-7931-40ad-9797-17814b854737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume 7c7e291c-d8ed-44e0-9fec-d90902f81b26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26', 'volume_size': 1} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596433408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7e291c-d8ed-44e0-9fec-d90902f81b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:35Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Creating volume 7c7e291c-d8ed-44e0-9fec-d90902f81b26 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:35 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:35 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26 1073741824 Aug 28 20:30:35 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Flow 'volume_create_manager' (e0973e65-1925-4238-b00d-e1ae1cb37d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbab29dd-95a8-4ab2-a982-6c529fc66c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbab29dd-95a8-4ab2-a982-6c529fc66c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1384941426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9930b49e-42f1-4d6d-8971-74b32b0dd786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0859ef8a74974d1b82a27350ea1fbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:36Z,use_quota=True,user_id='77d28524cc834bbd935e4e6fedbf293b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e17ef4d2-3332-46e6-909a-51ae55fbd776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e17ef4d2-3332-46e6-909a-51ae55fbd776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1004f29d-0446-4d26-ab16-e0558befa238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1004f29d-0446-4d26-ab16-e0558befa238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9930b49e-42f1-4d6d-8971-74b32b0dd786', 'volume_name': 'volume-9930b49e-42f1-4d6d-8971-74b32b0dd786', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e456b9-ed80-462a-ae30-92a105ba9aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e456b9-ed80-462a-ae30-92a105ba9aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae260347-0b1b-46d1-85d6-b52d7a67bed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Volume 9930b49e-42f1-4d6d-8971-74b32b0dd786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9930b49e-42f1-4d6d-8971-74b32b0dd786', 'volume_size': 1} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Flow 'volume_create_manager' (d5e5c121-93e7-42c3-89f8-c05cf99c5cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8082b1e-53ec-431e-b89e-c3decae8f9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8082b1e-53ec-431e-b89e-c3decae8f9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-540999033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb34d88-292c-4c88-b9d2-d5e6575f5ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0859ef8a74974d1b82a27350ea1fbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:36Z,use_quota=True,user_id='77d28524cc834bbd935e4e6fedbf293b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f75f479-1b7f-42f6-9fdb-8190946684c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f75f479-1b7f-42f6-9fdb-8190946684c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f96c38-8dd6-48b8-a34a-ba638b207f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f96c38-8dd6-48b8-a34a-ba638b207f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb34d88-292c-4c88-b9d2-d5e6575f5ac6', 'volume_name': 'volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137cb14f-07df-4d6a-b437-a50a9ce49533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137cb14f-07df-4d6a-b437-a50a9ce49533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e792d3d5-c952-4029-b923-e6e0ca372c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Volume 5bb34d88-292c-4c88-b9d2-d5e6575f5ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6', 'volume_size': 1} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:36 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26 1073741824" returned: 0 in 0.673s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:36 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26 Aug 28 20:30:36 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Flow 'volume_create_manager' (73f9f2ee-4722-4267-836b-91538ddb56b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2b0335-6cbf-405d-81c2-57f668a6c6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (ee9916a1-5375-4e79-9e66-173b9e1e61cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9390c9c-ec07-4066-aa0e-84d989f5d572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c2b0335-6cbf-405d-81c2-57f668a6c6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-245881741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eac732f-627c-415f-b493-d48ea5d3a0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0859ef8a74974d1b82a27350ea1fbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:36Z,use_quota=True,user_id='77d28524cc834bbd935e4e6fedbf293b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e50074b-dbef-4dbb-a523-c7bbdd73eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e50074b-dbef-4dbb-a523-c7bbdd73eef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b329983-3e84-440d-b333-6da31f6a91ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b329983-3e84-440d-b333-6da31f6a91ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eac732f-627c-415f-b493-d48ea5d3a0c8', 'volume_name': 'volume-5eac732f-627c-415f-b493-d48ea5d3a0c8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a686b4-3c48-462f-abab-7e2de6de07ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a686b4-3c48-462f-abab-7e2de6de07ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097b66f4-eaf3-4175-a65a-9380079b03ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Volume 5eac732f-627c-415f-b493-d48ea5d3a0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eac732f-627c-415f-b493-d48ea5d3a0c8', 'volume_size': 1} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:36 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9390c9c-ec07-4066-aa0e-84d989f5d572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1174131257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d8f47e-bc0f-4689-84b3-192fcb80eac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:36Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275a80fb-65c7-4b3a-a000-4ccff0d32c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275a80fb-65c7-4b3a-a000-4ccff0d32c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d171e285-0a14-45ec-9227-0ac66f6303d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d171e285-0a14-45ec-9227-0ac66f6303d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d8f47e-bc0f-4689-84b3-192fcb80eac0', 'volume_name': 'volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5130e4-5806-4e14-9724-4645174d211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5130e4-5806-4e14-9724-4645174d211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3e6f92-4a87-470f-b6b1-902f7593cf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume a5d8f47e-bc0f-4689-84b3-192fcb80eac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0', 'volume_size': 1} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26" returned: 0 in 0.352s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1384941426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9930b49e-42f1-4d6d-8971-74b32b0dd786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0859ef8a74974d1b82a27350ea1fbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:36Z,use_quota=True,user_id='77d28524cc834bbd935e4e6fedbf293b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Creating volume 9930b49e-42f1-4d6d-8971-74b32b0dd786 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:36 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb30024-7931-40ad-9797-17814b854737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786 1073741824 Aug 28 20:30:36 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638ae0fa-cb60-40e7-b03a-643777f1378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26 (7c7e291c-d8ed-44e0-9fec-d90902f81b26): created successfully Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (638ae0fa-cb60-40e7-b03a-643777f1378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (3e94d6d8-f777-48d4-b1e0-0454b38b4144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Flow 'volume_create_manager' (3cc0d4ea-13fd-4eff-adc2-c6a12b0052ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729fe9b8-8dfc-4736-b86a-adab71c25f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b154a968-2f75-464d-a959-a471bdd10955 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created volume successfully. Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729fe9b8-8dfc-4736-b86a-adab71c25f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1087354877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ab6393-3183-4305-af0e-7c30e545b005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0859ef8a74974d1b82a27350ea1fbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:37Z,use_quota=True,user_id='77d28524cc834bbd935e4e6fedbf293b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e0d1f8-1b1c-4c0b-a1ad-19f6efca7137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e0d1f8-1b1c-4c0b-a1ad-19f6efca7137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba15714-de52-4f64-a4ec-a7edde8c1d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba15714-de52-4f64-a4ec-a7edde8c1d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ab6393-3183-4305-af0e-7c30e545b005', 'volume_name': 'volume-a7ab6393-3183-4305-af0e-7c30e545b005', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f10004-70b3-46e0-b3e9-400172201c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f10004-70b3-46e0-b3e9-400172201c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bddd50c-f78d-412b-b00e-aa21854c216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Volume a7ab6393-3183-4305-af0e-7c30e545b005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ab6393-3183-4305-af0e-7c30e545b005', 'volume_size': 1} Aug 28 20:30:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Flow 'volume_create_manager' (637af682-97c9-4f14-a08a-e5affe1d0afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2a9e1b-5b70-41a3-9696-01b122532f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf2a9e1b-5b70-41a3-9696-01b122532f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107470194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16675cd1-4f83-41b4-952d-f5405ab23ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0859ef8a74974d1b82a27350ea1fbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:37Z,use_quota=True,user_id='77d28524cc834bbd935e4e6fedbf293b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:37 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9264f084-a81b-4a99-af1b-cfe5ae8b6ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9264f084-a81b-4a99-af1b-cfe5ae8b6ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59f0581-db73-4aab-8e41-18077c75e3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59f0581-db73-4aab-8e41-18077c75e3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16675cd1-4f83-41b4-952d-f5405ab23ccd', 'volume_name': 'volume-16675cd1-4f83-41b4-952d-f5405ab23ccd', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afa5dd6-806b-46ca-9596-fbaf1db53ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afa5dd6-806b-46ca-9596-fbaf1db53ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fea99f8-dcdb-4c17-bb1a-db053287614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:37 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Volume 16675cd1-4f83-41b4-952d-f5405ab23ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16675cd1-4f83-41b4-952d-f5405ab23ccd', 'volume_size': 1} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786 1073741824" returned: 0 in 0.606s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:37 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786 Aug 28 20:30:37 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:37 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786" returned: 0 in 0.272s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-540999033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb34d88-292c-4c88-b9d2-d5e6575f5ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0859ef8a74974d1b82a27350ea1fbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:36Z,use_quota=True,user_id='77d28524cc834bbd935e4e6fedbf293b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Creating volume 5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:37 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae260347-0b1b-46d1-85d6-b52d7a67bed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9930b49e-42f1-4d6d-8971-74b32b0dd786', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:37 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 1073741824 Aug 28 20:30:37 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1600b1-236c-4ac3-a0e1-0f40f8817df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:37 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Volume volume-9930b49e-42f1-4d6d-8971-74b32b0dd786 (9930b49e-42f1-4d6d-8971-74b32b0dd786): created successfully Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1600b1-236c-4ac3-a0e1-0f40f8817df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Flow 'volume_create_manager' (e0973e65-1925-4238-b00d-e1ae1cb37d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:37 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f79dc6e7-1106-4876-a4e5-2320c965f384 tempest-CreateVolumesFromImageTest-167757712 None] Created volume successfully. Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (ff4140b3-8eb5-4ca5-af60-7950e383e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a28b66-5428-4c78-8b58-7a9db6473ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a28b66-5428-4c78-8b58-7a9db6473ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441629647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00258e94-e44f-43ca-8c3c-72571621ade6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:38Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79a2bb6-6c38-40a4-bd0b-443ee4945a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79a2bb6-6c38-40a4-bd0b-443ee4945a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9080893a-054e-4291-bd49-94615c781ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9080893a-054e-4291-bd49-94615c781ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00258e94-e44f-43ca-8c3c-72571621ade6', 'volume_name': 'volume-00258e94-e44f-43ca-8c3c-72571621ade6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712c92b8-8ee2-4b86-82f7-ad22d1773475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712c92b8-8ee2-4b86-82f7-ad22d1773475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f38c2e-8e31-4e2f-b6c6-0fbbccc80734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume 00258e94-e44f-43ca-8c3c-72571621ade6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00258e94-e44f-43ca-8c3c-72571621ade6', 'volume_size': 1} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:38 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 1073741824" returned: 0 in 0.628s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:38 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 Aug 28 20:30:38 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (646c81ac-c019-4444-aed3-80653ec9bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ea4606-7f23-4a1f-ab7d-64c4150a4480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ea4606-7f23-4a1f-ab7d-64c4150a4480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-77998549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:38Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f124f899-cf9c-4c75-a7cf-fc5282337562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f124f899-cf9c-4c75-a7cf-fc5282337562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fd3975-6884-42d4-ad68-73a20f330a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fd3975-6884-42d4-ad68-73a20f330a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c', 'volume_name': 'volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6df8ff-dea2-4786-8739-0b733151b9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6df8ff-dea2-4786-8739-0b733151b9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5cb815-305e-4880-b501-bbeff2e2af39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume 0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c', 'volume_size': 1} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:38 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6" returned: 0 in 0.360s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.049s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-245881741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eac732f-627c-415f-b493-d48ea5d3a0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0859ef8a74974d1b82a27350ea1fbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:36Z,use_quota=True,user_id='77d28524cc834bbd935e4e6fedbf293b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Creating volume 5eac732f-627c-415f-b493-d48ea5d3a0c8 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:38 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:38 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8 1073741824 Aug 28 20:30:38 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e792d3d5-c952-4029-b923-e6e0ca372c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f839b4bd-4c16-41c8-b3dc-d743f3917721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Volume volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 (5bb34d88-292c-4c88-b9d2-d5e6575f5ac6): created successfully Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f839b4bd-4c16-41c8-b3dc-d743f3917721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Flow 'volume_create_manager' (d5e5c121-93e7-42c3-89f8-c05cf99c5cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0336e829-1d62-4c8c-8b0b-55225f7e493e tempest-CreateVolumesFromImageTest-167757712 None] Created volume successfully. Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (9d8c45fc-5640-4f6c-9540-83b306cd87ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e03889-a623-4703-afe7-8b012c135924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e03889-a623-4703-afe7-8b012c135924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2121675833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a776b897-97ff-4e40-9b7c-7a40a11b7c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:39Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f869d794-dc1e-4923-bd86-e238dbf6a881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f869d794-dc1e-4923-bd86-e238dbf6a881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e90db0a-dd0b-46cb-b894-04827bc0a6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e90db0a-dd0b-46cb-b894-04827bc0a6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a776b897-97ff-4e40-9b7c-7a40a11b7c14', 'volume_name': 'volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf19de43-1113-4127-accb-9a2a3c21caf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf19de43-1113-4127-accb-9a2a3c21caf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dec8ec5-abed-4ab8-8cb2-19db206d3224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:38 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume a776b897-97ff-4e40-9b7c-7a40a11b7c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14', 'volume_size': 1} Aug 28 20:30:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:39 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (58544282-5183-408f-bbce-921dce49dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e467d7b-d85c-4ba7-8e13-fe73409a6a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8 1073741824" returned: 0 in 0.579s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e467d7b-d85c-4ba7-8e13-fe73409a6a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450109796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1db2524-6615-44ac-8066-31809094c87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:39Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189e6531-ee9b-487f-b5a7-df7ffd7e3e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189e6531-ee9b-487f-b5a7-df7ffd7e3e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384a3512-0a5f-45f9-afc3-eca70519733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384a3512-0a5f-45f9-afc3-eca70519733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1db2524-6615-44ac-8066-31809094c87d', 'volume_name': 'volume-e1db2524-6615-44ac-8066-31809094c87d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d511009f-f134-4581-90f8-d5680b5fe72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d511009f-f134-4581-90f8-d5680b5fe72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ccfed2-54c4-472a-bd85-8d50df4640b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume e1db2524-6615-44ac-8066-31809094c87d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1db2524-6615-44ac-8066-31809094c87d', 'volume_size': 1} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:39 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8 Aug 28 20:30:39 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:39 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8" returned: 0 in 0.314s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.997s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1174131257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d8f47e-bc0f-4689-84b3-192fcb80eac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:36Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Creating volume a5d8f47e-bc0f-4689-84b3-192fcb80eac0 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:39 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:39 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 1073741824 Aug 28 20:30:39 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097b66f4-eaf3-4175-a65a-9380079b03ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eac732f-627c-415f-b493-d48ea5d3a0c8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfc9bf7-8105-42d5-8825-e39a07113c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (991d3bd5-8565-4b2b-8c58-10b4c6909886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13fea831-956b-4d62-840c-32486a264b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Volume volume-5eac732f-627c-415f-b493-d48ea5d3a0c8 (5eac732f-627c-415f-b493-d48ea5d3a0c8): created successfully Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfc9bf7-8105-42d5-8825-e39a07113c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Flow 'volume_create_manager' (73f9f2ee-4722-4267-836b-91538ddb56b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13fea831-956b-4d62-840c-32486a264b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-941006182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95a416f-cbdb-46c3-a690-06ef5d44c4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:40Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce962936-3648-4d01-969d-f696bab8b322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce962936-3648-4d01-969d-f696bab8b322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00be669-2696-4709-9cbe-2454557598e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00be669-2696-4709-9cbe-2454557598e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95a416f-cbdb-46c3-a690-06ef5d44c4af', 'volume_name': 'volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb623210-5825-4bba-855a-17bfcbc61b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb623210-5825-4bba-855a-17bfcbc61b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ea1cab-fed8-415b-98f5-2d0aa5c98115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:39 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume c95a416f-cbdb-46c3-a690-06ef5d44c4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af', 'volume_size': 1} Aug 28 20:30:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4b8ad1b6-35e9-473f-9260-4f2f07c1f2f5 tempest-CreateVolumesFromImageTest-167757712 None] Created volume successfully. Aug 28 20:30:40 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 1073741824" returned: 0 in 0.457s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:40 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 Aug 28 20:30:40 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Flow 'volume_create_manager' (1684dc86-f252-4df7-9033-3bff7d9f3bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f5352a-8816-44fe-ae26-45dc4bba59cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f5352a-8816-44fe-ae26-45dc4bba59cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f270cb-6750-4696-94fc-1f752a5b7ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68055a7e42e4aa388e4f1ecac9004db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:40Z,use_quota=True,user_id='514f786322d045d99f2f6894f51b31a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(226dc57f-e35f-4bec-acbf-f0b42de2d664),volume_type_id=226dc57f-e35f-4bec-acbf-f0b42de2d664)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3393270f-1ed2-4ccc-b0da-ad9dca43d9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3393270f-1ed2-4ccc-b0da-ad9dca43d9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aeaf437-ed04-4063-ad1a-658512ef4230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.image.glance [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Creating Keystone auth plugin from conf {{(pid=86028) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 20:30:40 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" returned: 0 in 0.257s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.494s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1087354877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ab6393-3183-4305-af0e-7c30e545b005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0859ef8a74974d1b82a27350ea1fbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:37Z,use_quota=True,user_id='77d28524cc834bbd935e4e6fedbf293b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Creating volume a7ab6393-3183-4305-af0e-7c30e545b005 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:40 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:40 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005 1073741824 Aug 28 20:30:40 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3e6f92-4a87-470f-b6b1-902f7593cf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74450e8d-2442-4c7e-8083-c8205105fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:40 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 (a5d8f47e-bc0f-4689-84b3-192fcb80eac0): created successfully Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74450e8d-2442-4c7e-8083-c8205105fc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (ee9916a1-5375-4e79-9e66-173b9e1e61cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1cc2af26-607e-451d-a5bc-245cde33a7a7 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created volume successfully. Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aeaf437-ed04-4063-ad1a-658512ef4230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14f270cb-6750-4696-94fc-1f752a5b7ed7', 'volume_name': 'volume-14f270cb-6750-4696-94fc-1f752a5b7ed7', 'volume_size': 1, 'image_id': '454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0342ef26cf35c71ec39abf3448099a41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b68055a7e42e4aa388e4f1ecac9004db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfaac4d44d7d775b3a3f44db920834d3eb2eb64e1a0a587bda9a323f81196d6f1130539d8362253ddcc4cc7546f7109d5db965bd2563bae6789af019311dc59e', 'id': '454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'created_at': datetime.datetime(2026, 8, 28, 18, 30, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 30, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/454d37ca-4a29-4f5b-b7f7-0fb511981ad1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf36b2f-e05c-45e9-b78d-6d6b82944cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf36b2f-e05c-45e9-b78d-6d6b82944cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f809ffb7-8f4e-4890-ad22-944a10902e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:40 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Volume 14f270cb-6750-4696-94fc-1f752a5b7ed7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14f270cb-6750-4696-94fc-1f752a5b7ed7', 'volume_size': 1, 'image_id': '454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0342ef26cf35c71ec39abf3448099a41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b68055a7e42e4aa388e4f1ecac9004db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfaac4d44d7d775b3a3f44db920834d3eb2eb64e1a0a587bda9a323f81196d6f1130539d8362253ddcc4cc7546f7109d5db965bd2563bae6789af019311dc59e', 'id': '454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'created_at': datetime.datetime(2026, 8, 28, 18, 30, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 30, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/454d37ca-4a29-4f5b-b7f7-0fb511981ad1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Trying to clone 14f270cb-6750-4696-94fc-1f752a5b7ed7 from image 454d37ca-4a29-4f5b-b7f7-0fb511981ad1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'metadata': {}}]). {{(pid=86028) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 20:30:40 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Image download 0.00 MB at 0.00 MB/s Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a01a62e-87fe-4ace-8627-477aa9e67dc2]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:40 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005 1073741824" returned: 0 in 0.538s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:41 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005 Aug 28 20:30:41 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:41 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD Aug 28 20:30:41 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:41 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:41 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005" returned: 0 in 0.276s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.997s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107470194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16675cd1-4f83-41b4-952d-f5405ab23ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0859ef8a74974d1b82a27350ea1fbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:37Z,use_quota=True,user_id='77d28524cc834bbd935e4e6fedbf293b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Creating volume 16675cd1-4f83-41b4-952d-f5405ab23ccd {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:41 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bddd50c-f78d-412b-b00e-aa21854c216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ab6393-3183-4305-af0e-7c30e545b005', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116b8b91-5bca-40a5-b9a2-4ccf546ef34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:41 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd 1073741824 Aug 28 20:30:41 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:41 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Volume volume-a7ab6393-3183-4305-af0e-7c30e545b005 (a7ab6393-3183-4305-af0e-7c30e545b005): created successfully Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116b8b91-5bca-40a5-b9a2-4ccf546ef34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Flow 'volume_create_manager' (3cc0d4ea-13fd-4eff-adc2-c6a12b0052ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9d791a54-a5bd-4339-a375-39824d29c5e2 tempest-CreateVolumesFromImageTest-167757712 None] Created volume successfully. Aug 28 20:30:41 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD Aug 28 20:30:41 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:41 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Temporary image 454d37ca-4a29-4f5b-b7f7-0fb511981ad1 is fetched for user 514f786322d045d99f2f6894f51b31a4. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83d2ead-37fe-4238-b18e-4a912f0d135a]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:41 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd 1073741824" returned: 0 in 0.445s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:41 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd Aug 28 20:30:41 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:41 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD Aug 28 20:30:41 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:42 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd" returned: 0 in 0.265s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.991s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441629647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00258e94-e44f-43ca-8c3c-72571621ade6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:38Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Creating volume 00258e94-e44f-43ca-8c3c-72571621ade6 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:42 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:42 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:42 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6 1073741824 Aug 28 20:30:42 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fea99f8-dcdb-4c17-bb1a-db053287614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16675cd1-4f83-41b4-952d-f5405ab23ccd', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728242c4-1958-41bd-b583-36d908bb06ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:42 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Volume volume-16675cd1-4f83-41b4-952d-f5405ab23ccd (16675cd1-4f83-41b4-952d-f5405ab23ccd): created successfully Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728242c4-1958-41bd-b583-36d908bb06ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Flow 'volume_create_manager' (637af682-97c9-4f14-a08a-e5affe1d0afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:42 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-403f3358-ebba-4aef-bd4e-80234483e403 tempest-CreateVolumesFromImageTest-167757712 None] Created volume successfully. Aug 28 20:30:42 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD Aug 28 20:30:42 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:42 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:42 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6 1073741824" returned: 0 in 0.405s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:42 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6 Aug 28 20:30:42 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:42 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6" returned: 0 in 0.257s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.216s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-77998549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:38Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Creating volume 0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:42 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f38c2e-8e31-4e2f-b6c6-0fbbccc80734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00258e94-e44f-43ca-8c3c-72571621ade6', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:42 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c 1073741824 Aug 28 20:30:42 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3db53f-f3b8-4731-8881-de08ba656656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:42 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume volume-00258e94-e44f-43ca-8c3c-72571621ade6 (00258e94-e44f-43ca-8c3c-72571621ade6): created successfully Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3db53f-f3b8-4731-8881-de08ba656656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:42 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (ff4140b3-8eb5-4ca5-af60-7950e383e57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:42 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0df96cad-ac55-4d4a-8927-170ae6e1d539 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created volume successfully. Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "cinder-16675cd1-4f83-41b4-952d-f5405ab23ccd-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-16675cd1-4f83-41b4-952d-f5405ab23ccd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "cinder-quobyte-16675cd1-4f83-41b4-952d-f5405ab23ccd" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-quobyte-16675cd1-4f83-41b4-952d-f5405ab23ccd" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c2990f-eab5-4a90-ae9f-41986ac14f67]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:43 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c 1073741824" returned: 0 in 0.462s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:43 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd Aug 28 20:30:43 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:43 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c Aug 28 20:30:43 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:43 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd" returned: 0 in 0.362s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:43 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.589s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2121675833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a776b897-97ff-4e40-9b7c-7a40a11b7c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:39Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Creating volume a776b897-97ff-4e40-9b7c-7a40a11b7c14 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:43 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:43 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:43 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5cb815-305e-4880-b501-bbeff2e2af39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:43 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14 1073741824 Aug 28 20:30:43 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8e2304-7353-40c3-86a8-f41ab7778acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:43 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c (0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c): created successfully Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8e2304-7353-40c3-86a8-f41ab7778acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (646c81ac-c019-4444-aed3-80653ec9bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:43 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-14c11be9-1663-4299-88fc-7dbb6687fde6 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created volume successfully. Aug 28 20:30:43 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-16675cd1-4f83-41b4-952d-f5405ab23ccd" returned: 0 in 0.250s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-quobyte-16675cd1-4f83-41b4-952d-f5405ab23ccd" released by "delete_volume" :: held 0.657s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Created reservations ['dda0b25d-f67b-4118-b8f1-b907e9d7443a', '2db9e566-09ef-427b-ad32-7fa1691be290', '10f907f5-fdf6-4ac2-a728-f8b3570794d0', '022e0e96-d0bc-4049-8e96-be435608f2bc'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:43 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:43 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:44 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14 1073741824" returned: 0 in 0.493s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:44 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14 Aug 28 20:30:44 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:44 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.275s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:44 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Deleted volume successfully. Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-16791fdb-7eb5-4573-a53f-6ea22ce2f42e tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-16675cd1-4f83-41b4-952d-f5405ab23ccd-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "cinder-a7ab6393-3183-4305-af0e-7c30e545b005-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-a7ab6393-3183-4305-af0e-7c30e545b005-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "cinder-quobyte-a7ab6393-3183-4305-af0e-7c30e545b005" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-quobyte-a7ab6393-3183-4305-af0e-7c30e545b005" acquired by "delete_volume" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fcc5c9-45be-4a3c-8c43-6778750c83e0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:44 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14" returned: 0 in 0.293s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.060s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450109796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1db2524-6615-44ac-8066-31809094c87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:39Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Creating volume e1db2524-6615-44ac-8066-31809094c87d {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:44 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dec8ec5-abed-4ab8-8cb2-19db206d3224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:44 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d 1073741824 Aug 28 20:30:44 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd68d80-f545-4b58-b103-fc6b479ffede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:44 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14 (a776b897-97ff-4e40-9b7c-7a40a11b7c14): created successfully Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd68d80-f545-4b58-b103-fc6b479ffede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (9d8c45fc-5640-4f6c-9540-83b306cd87ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:44 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005 Aug 28 20:30:44 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:44 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9b553c93-b783-420a-bc61-808c751c4a8a tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created volume successfully. Aug 28 20:30:44 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005" returned: 0 in 0.366s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:44 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005 Aug 28 20:30:44 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:44 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d 1073741824" returned: 0 in 0.430s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:44 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d Aug 28 20:30:44 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:44 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a7ab6393-3183-4305-af0e-7c30e545b005" returned: 0 in 0.272s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-quobyte-a7ab6393-3183-4305-af0e-7c30e545b005" released by "delete_volume" :: held 0.679s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Created reservations ['20fd70d3-2b2a-4f70-9d22-932b34f46ae4', '80255208-d619-49f5-845e-f1c843b2d2dd', '08a46718-31ec-443f-a36f-da6de78af4f9', 'd1e9383d-289e-4934-b336-77f6d6696f28'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:45 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d" returned: 0 in 0.269s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.303s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-941006182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95a416f-cbdb-46c3-a690-06ef5d44c4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54a4618ff2340469fc223a0f9e41dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:40Z,use_quota=True,user_id='06052d53e2234f7dbecaa0df5eeb7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Creating volume c95a416f-cbdb-46c3-a690-06ef5d44c4af {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:45 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ccfed2-54c4-472a-bd85-8d50df4640b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1db2524-6615-44ac-8066-31809094c87d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c800e2ac-7d47-449e-a775-e6f478f734db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:45 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af 1073741824 Aug 28 20:30:45 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:45 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume volume-e1db2524-6615-44ac-8066-31809094c87d (e1db2524-6615-44ac-8066-31809094c87d): created successfully Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c800e2ac-7d47-449e-a775-e6f478f734db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (58544282-5183-408f-bbce-921dce49dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:45 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:45 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-63504e7a-ca02-4b2b-bd23-7b94a43caebd tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created volume successfully. Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "cinder-5eac732f-627c-415f-b493-d48ea5d3a0c8-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-5eac732f-627c-415f-b493-d48ea5d3a0c8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "cinder-quobyte-5eac732f-627c-415f-b493-d48ea5d3a0c8" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-quobyte-5eac732f-627c-415f-b493-d48ea5d3a0c8" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:45 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.319s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Deleted volume successfully. Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[da36d0f1-c787-4379-bd0a-08d6b6894e65]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0ab2091f-ad90-4a2d-8667-f4a57df79457 tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-a7ab6393-3183-4305-af0e-7c30e545b005-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:45 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af 1073741824" returned: 0 in 0.507s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:45 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8 Aug 28 20:30:45 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:45 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af Aug 28 20:30:45 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:45 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8" returned: 0 in 0.382s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:45 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:45 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8 Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af" returned: 0 in 0.264s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:45 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.046s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ea1cab-fed8-415b-98f5-2d0aa5c98115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fb37d2-a8d1-460d-a6f2-9d8dcd49217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Creating offline snapshot 47db308f-e16c-4bdc-982a-159575d5ae9c of volume a5d8f47e-bc0f-4689-84b3-192fcb80eac0 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:30:46 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Volume volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af (c95a416f-cbdb-46c3-a690-06ef5d44c4af): created successfully Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fb37d2-a8d1-460d-a6f2-9d8dcd49217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Flow 'volume_create_manager' (991d3bd5-8565-4b2b-8c58-10b4c6909886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a551df3d-fc45-48f7-b7f4-1b543877e3a8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:46 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2e0a68c9-f166-4687-ac54-13d74cbca651 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created volume successfully. Aug 28 20:30:46 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 Aug 28 20:30:46 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:46 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5eac732f-627c-415f-b493-d48ea5d3a0c8" returned: 0 in 0.260s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-quobyte-5eac732f-627c-415f-b493-d48ea5d3a0c8" released by "delete_volume" :: held 0.687s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Created reservations ['68a4fafa-c391-442a-a609-495281475666', 'd9083543-a2d4-4196-b45f-616a310f9346', '79d585eb-0e0e-41c2-add9-cd633d871026', 'd9ac8bd2-2372-4aae-9b94-e0da5a0e50e7'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:46 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:46 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-c95a416f-cbdb-46c3-a690-06ef5d44c4af-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:46 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" returned: 0 in 0.419s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-c95a416f-cbdb-46c3-a690-06ef5d44c4af-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:46 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c 1G Aug 28 20:30:46 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-quobyte-c95a416f-cbdb-46c3-a690-06ef5d44c4af" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-c95a416f-cbdb-46c3-a690-06ef5d44c4af" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95e159f-126e-46dd-8dfa-454fc4276a34]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:46 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "cinder-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.337s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:46 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Deleted volume successfully. Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:46 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af Aug 28 20:30:46 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-4cc15f92-2006-48af-acbc-79a04cbd2289 tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-5eac732f-627c-415f-b493-d48ea5d3a0c8-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "cinder-quobyte-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-quobyte-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04855b3-3e72-479f-9165-c53dbe441ae2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:46 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 Aug 28 20:30:46 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:46 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c 1G" returned: 0 in 0.503s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:46 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c Aug 28 20:30:46 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:47 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af" returned: 0 in 0.447s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:47 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af Aug 28 20:30:47 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:47 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6" returned: 0 in 0.403s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:47 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6 Aug 28 20:30:47 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:47 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c" returned: 0 in 0.312s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:47 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c is being set with open permissions: ugo+rw Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:47 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c95a416f-cbdb-46c3-a690-06ef5d44c4af" returned: 0 in 0.263s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:47 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c Aug 28 20:30:47 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-c95a416f-cbdb-46c3-a690-06ef5d44c4af" released by "delete_volume" :: held 0.783s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created reservations ['2a2ff6ae-0c25-4bdb-bb3d-a779f2f6c624', '54a6740d-c974-4db7-8be3-8204e8379006', 'ba05a9c5-eb5e-4b74-8c99-2ce098b706c8', '24d55279-4666-4a83-80b2-295381b08284'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:47 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:47 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:47 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6" returned: 0 in 0.263s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-quobyte-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6" released by "delete_volume" :: held 0.718s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:47 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c" returned: 0 in 0.272s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Created reservations ['5ba3d406-f519-4dc8-9eb2-4417cb43e07e', 'f9777d6c-41af-47e1-a4ec-75d926bc6283', '2eba9ea6-7d03-45ed-9f83-0ff73ed0eb8e', 'a4f5d847-e3e9-4f9f-b1b2-f41c7158d7e5'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:47 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.info Aug 28 20:30:47 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-e1db2524-6615-44ac-8066-31809094c87d-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-e1db2524-6615-44ac-8066-31809094c87d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:47 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.307s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:47 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:47 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:47 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Deleted volume successfully. Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7fbff8a4-b9f3-477d-a453-6fcd67435f6c tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-c95a416f-cbdb-46c3-a690-06ef5d44c4af-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-quobyte-e1db2524-6615-44ac-8066-31809094c87d" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-e1db2524-6615-44ac-8066-31809094c87d" acquired by "delete_volume" :: waited 0.026s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b16b944-2753-438a-bfa5-0d1774b611c9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "cinder-9930b49e-42f1-4d6d-8971-74b32b0dd786-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:47 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-9930b49e-42f1-4d6d-8971-74b32b0dd786-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:48 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.info" returned: 0 in 0.442s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:48 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.info is being set with open permissions: ugo+rw Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:48 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.369s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Deleted volume successfully. Aug 28 20:30:48 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d Aug 28 20:30:48 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:48 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.info Aug 28 20:30:48 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "cinder-quobyte-9930b49e-42f1-4d6d-8971-74b32b0dd786" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b5e2f3c-3ebf-4a05-ba81-3d8d7c6dfbef tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-5bb34d88-292c-4c88-b9d2-d5e6575f5ac6-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-quobyte-9930b49e-42f1-4d6d-8971-74b32b0dd786" acquired by "delete_volume" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bfd44c-bb4c-41e6-9ff3-f2743a89c8c5]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:48 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786 Aug 28 20:30:48 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:48 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.info" returned: 0 in 0.282s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:48 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.902s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f270cb-6750-4696-94fc-1f752a5b7ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68055a7e42e4aa388e4f1ecac9004db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:40Z,use_quota=True,user_id='514f786322d045d99f2f6894f51b31a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(226dc57f-e35f-4bec-acbf-f0b42de2d664),volume_type_id=226dc57f-e35f-4bec-acbf-f0b42de2d664)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Creating volume 14f270cb-6750-4696-94fc-1f752a5b7ed7 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:48 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d" returned: 0 in 0.446s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:48 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 1073741824 Aug 28 20:30:48 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:48 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d Aug 28 20:30:48 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-cc9d0632-d808-4d01-8f3c-903cd5d73eab tempest-CreateVolumesFromSnapshotTest-1977770439 None] Create snapshot completed successfully Aug 28 20:30:48 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:48 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786 Aug 28 20:30:48 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:48 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e1db2524-6615-44ac-8066-31809094c87d" returned: 0 in 0.279s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-e1db2524-6615-44ac-8066-31809094c87d" released by "delete_volume" :: held 0.792s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created reservations ['6f38328b-aa89-485e-8156-1019ff5f6be5', '78544b52-1627-4b0b-b600-d39152175070', '8ce48fed-ffc2-489f-9578-3d36d2d9c759', '6e1775be-7011-4fc6-8c06-63dcf2130088'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:48 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9930b49e-42f1-4d6d-8971-74b32b0dd786" returned: 0 in 0.291s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:48 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:48 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-quobyte-9930b49e-42f1-4d6d-8971-74b32b0dd786" released by "delete_volume" :: held 0.758s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:48 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 1073741824" returned: 0 in 0.538s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-a776b897-97ff-4e40-9b7c-7a40a11b7c14-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-a776b897-97ff-4e40-9b7c-7a40a11b7c14-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:48 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 Aug 28 20:30:48 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-quobyte-a776b897-97ff-4e40-9b7c-7a40a11b7c14" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Created reservations ['81fe1a5c-1fcc-4a14-a3f2-a45bb2eb7c29', '200d9ee9-a0da-4619-bfdf-548a64ee86af', '11bec72f-a2e5-4c92-979b-70c30f337297', '0dbb9080-57d6-4cba-aebf-07f219ebc7e1'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-a776b897-97ff-4e40-9b7c-7a40a11b7c14" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e3cc3e-24ca-4e65-8f32-c052f4a1df2e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:49 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.314s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Deleted volume successfully. Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-57d2bc46-8453-45f0-8da2-f74173d4b410 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-e1db2524-6615-44ac-8066-31809094c87d-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:49 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:49 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:49 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14 Aug 28 20:30:49 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:49 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7" returned: 0 in 0.345s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Attempting download of 454d37ca-4a29-4f5b-b7f7-0fb511981ad1 ((None, [{'url': 'file:///opt/stack/data/glance/images/454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'metadata': {}}])) to volume 14f270cb-6750-4696-94fc-1f752a5b7ed7. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7deb817-3f40-4db7-a1ae-b24c8763705c]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_fc20r1vx {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:49 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.310s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Deleted volume successfully. Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7e57d7-7d98-4ef1-bb93-0e42db662e8c tempest-CreateVolumesFromImageTest-167757712 None] Lock "cinder-9930b49e-42f1-4d6d-8971-74b32b0dd786-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:49 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14" returned: 0 in 0.466s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:49 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_fc20r1vx Aug 28 20:30:49 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:49 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14 Aug 28 20:30:49 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:49 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_fc20r1vx" returned: 0 in 0.373s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_fc20r1vx {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:49 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a776b897-97ff-4e40-9b7c-7a40a11b7c14" returned: 0 in 0.289s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (b9116356-1dab-4841-982c-d2a671a6de56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d98dfd5-d797-495d-a049-87124fb1bcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-a776b897-97ff-4e40-9b7c-7a40a11b7c14" released by "delete_volume" :: held 0.853s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d98dfd5-d797-495d-a049-87124fb1bcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-286127732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72619dee-991d-4cb1-9e1b-bd26adb4c66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:50Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f879f3db-bf87-4419-8d36-bee5a1731a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f879f3db-bf87-4419-8d36-bee5a1731a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347ca256-0263-4562-b3be-1a588a9638e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347ca256-0263-4562-b3be-1a588a9638e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72619dee-991d-4cb1-9e1b-bd26adb4c66b', 'volume_name': 'volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c29abb5-0c3e-4a9b-8a00-63ef2f3688d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c29abb5-0c3e-4a9b-8a00-63ef2f3688d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d86ad4-85bd-4e53-aed8-e403a7ac00b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:49 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume 72619dee-991d-4cb1-9e1b-bd26adb4c66b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b', 'volume_size': 1} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-286127732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72619dee-991d-4cb1-9e1b-bd26adb4c66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:50Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Creating volume 72619dee-991d-4cb1-9e1b-bd26adb4c66b {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:49 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_fc20r1vx Aug 28 20:30:49 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:49 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:49 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b 1073741824 Aug 28 20:30:49 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created reservations ['e0dc3553-d380-4cd7-8492-f5d793ec9e20', '24c41995-bf51-4f01-a6db-c5d770039ddf', 'dad0a4b6-c820-41f9-ade6-641ddf1ef11a', '289102c6-84b6-4632-bbe0-687757302a47'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:50 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:50 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:50 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_fc20r1vx" returned: 1 in 0.567s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_fc20r1vx' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c4836d-b3d5-4790-8994-9bd5604b3aef]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (341b4467-8c1d-438b-8fcb-126cc7372054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c61f3fc-d6d5-44db-acf5-3b78fadfd647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c61f3fc-d6d5-44db-acf5-3b78fadfd647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1951552129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c52120-a8e2-44b1-919e-6593c20c9fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:50Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19755efa-0e26-4d2d-81c7-48ac45237f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19755efa-0e26-4d2d-81c7-48ac45237f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012d1b49-43d8-4c24-b977-cd1fe5dc59e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012d1b49-43d8-4c24-b977-cd1fe5dc59e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c52120-a8e2-44b1-919e-6593c20c9fdf', 'volume_name': 'volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae9cdc0-1383-4a75-9457-0088f27f13d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae9cdc0-1383-4a75-9457-0088f27f13d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d86d08-687d-4309-ad1b-0e053e15b9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:50 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume b0c52120-a8e2-44b1-919e-6593c20c9fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf', 'volume_size': 1} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:50 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD Aug 28 20:30:50 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:50 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.385s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Deleted volume successfully. Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-490815db-de27-43c9-9f42-0ae34952d14e tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-a776b897-97ff-4e40-9b7c-7a40a11b7c14-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:50 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b 1073741824" returned: 0 in 0.769s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:50 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b Aug 28 20:30:50 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:50 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (3fbffb97-5a1d-4613-9688-649f72af108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f6c189-95f3-441c-87b8-f23f55b1b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD" returned: 0 in 0.605s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f6c189-95f3-441c-87b8-f23f55b1b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139358130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dabcc93-b590-47a6-a201-ce14bd652cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:51Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68276f89-ebc3-4b1d-b114-3f2798da3981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68276f89-ebc3-4b1d-b114-3f2798da3981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acf8286-4bec-47e3-8708-48bee602a51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acf8286-4bec-47e3-8708-48bee602a51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dabcc93-b590-47a6-a201-ce14bd652cfe', 'volume_name': 'volume-7dabcc93-b590-47a6-a201-ce14bd652cfe', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfd6728-e3ab-4581-88a7-e71f361ee952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfd6728-e3ab-4581-88a7-e71f361ee952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32bb572-d4ac-4c06-8f5e-4dfe3335024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:51 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD Aug 28 20:30:51 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume 7dabcc93-b590-47a6-a201-ce14bd652cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dabcc93-b590-47a6-a201-ce14bd652cfe', 'volume_size': 1} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:51 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:51 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b" returned: 0 in 0.471s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1951552129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c52120-a8e2-44b1-919e-6593c20c9fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:50Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Creating volume b0c52120-a8e2-44b1-919e-6593c20c9fdf {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:51 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:51 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf 1073741824 Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:51 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d86ad4-85bd-4e53-aed8-e403a7ac00b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f8beb4-372b-44a6-821a-5ebeb8efc7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:51 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b (72619dee-991d-4cb1-9e1b-bd26adb4c66b): created successfully Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f8beb4-372b-44a6-821a-5ebeb8efc7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (b9116356-1dab-4841-982c-d2a671a6de56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:51 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-45fdd621-82f2-4e46-9bde-4d056acf1b2d tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created volume successfully. Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (389bbf1d-1e3e-4fd3-98c4-57080bd07fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a229b1c1-4d11-4c7f-8561-ceec66d3fea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:51 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD" returned: 1 in 0.600s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] 454d37ca-4a29-4f5b-b7f7-0fb511981ad1 was raw, converting to qcow2 {{(pid=86028) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-quobyte-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a229b1c1-4d11-4c7f-8561-ceec66d3fea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482102077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79750e00-5f8e-4f9e-8634-64d427db559e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:51Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75bd123-5a51-4961-9fb5-9cff9c4e0263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:51 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75bd123-5a51-4961-9fb5-9cff9c4e0263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:51 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba80c1c9-56be-4765-a905-a30c4b91f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba80c1c9-56be-4765-a905-a30c4b91f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79750e00-5f8e-4f9e-8634-64d427db559e', 'volume_name': 'volume-79750e00-5f8e-4f9e-8634-64d427db559e', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfb9184-1621-47c4-8bc6-1f085f29ab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfb9184-1621-47c4-8bc6-1f085f29ab78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edea56e2-f2c4-463e-8492-4fca005e20df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:51 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume 79750e00-5f8e-4f9e-8634-64d427db559e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79750e00-5f8e-4f9e-8634-64d427db559e', 'volume_size': 1} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c" acquired by "delete_volume" :: waited 0.075s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d23542-7da7-456c-9a12-642e8f880c57]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:51 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c Aug 28 20:30:51 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (56d5c654-e6f9-4dcf-9e33-2b10f6923ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90be109a-53e7-438f-b0fc-4e697d808f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90be109a-53e7-438f-b0fc-4e697d808f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-534590589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09286f4-efae-4e20-9396-1173eae1ce6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:52Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f5c663-6404-4170-812f-6ae90ba2ab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f5c663-6404-4170-812f-6ae90ba2ab28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a54324e-b1fd-4b6f-80c9-a55a6f26615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a54324e-b1fd-4b6f-80c9-a55a6f26615e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09286f4-efae-4e20-9396-1173eae1ce6c', 'volume_name': 'volume-e09286f4-efae-4e20-9396-1173eae1ce6c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f75e02-03ef-4afc-a3ab-013b7e4e9da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f75e02-03ef-4afc-a3ab-013b7e4e9da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b45f33-7c25-4055-9d01-8eb0e56f8f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume e09286f4-efae-4e20-9396-1173eae1ce6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09286f4-efae-4e20-9396-1173eae1ce6c', 'volume_size': 1} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:52 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf 1073741824" returned: 0 in 0.864s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:52 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf Aug 28 20:30:52 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:52 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7" returned: 0 in 0.716s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:52 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_454d37ca-4a29-4f5b-b7f7-0fb511981ad1_sfd2v7nedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:30:52 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c" returned: 0 in 0.602s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:52 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 1G Aug 28 20:30:52 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:52 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c Aug 28 20:30:52 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:52 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf" returned: 0 in 0.387s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139358130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dabcc93-b590-47a6-a201-ce14bd652cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:51Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Creating volume 7dabcc93-b590-47a6-a201-ce14bd652cfe {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:52 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:52 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe 1073741824 Aug 28 20:30:52 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d86d08-687d-4309-ad1b-0e053e15b9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e15b714-2bba-4e27-a4cf-8cac0933c9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:52 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c" returned: 0 in 0.324s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf (b0c52120-a8e2-44b1-919e-6593c20c9fdf): created successfully Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e15b714-2bba-4e27-a4cf-8cac0933c9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (341b4467-8c1d-438b-8fcb-126cc7372054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c" released by "delete_volume" :: held 1.002s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3d1d23d0-580c-4122-b5e1-5b501b477bde tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created volume successfully. Aug 28 20:30:52 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 1G" returned: 0 in 0.433s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Downloaded image 454d37ca-4a29-4f5b-b7f7-0fb511981ad1 ((None, [{'url': 'file:///opt/stack/data/glance/images/454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'metadata': {}}])) to volume 14f270cb-6750-4696-94fc-1f752a5b7ed7 successfully. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Temporary image 454d37ca-4a29-4f5b-b7f7-0fb511981ad1 for user 514f786322d045d99f2f6894f51b31a4 is deleted. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Marking volume 14f270cb-6750-4696-94fc-1f752a5b7ed7 as bootable. {{(pid=86028) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created reservations ['2a17e5a4-7bd3-4720-8994-c6aa366afd3a', 'a2d3e8e6-866f-4fbc-abd6-952cf504d48b', '6bc53de2-8f1e-4a0e-9249-a973bcd43ea1', '93d47499-c4ee-4457-b9ff-3ae5b9366645'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Copying metadata from image 454d37ca-4a29-4f5b-b7f7-0fb511981ad1 to 14f270cb-6750-4696-94fc-1f752a5b7ed7. {{(pid=86028) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Creating volume glance metadata for volume 14f270cb-6750-4696-94fc-1f752a5b7ed7 backed by image 454d37ca-4a29-4f5b-b7f7-0fb511981ad1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0342ef26cf35c71ec39abf3448099a41', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86028) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f809ffb7-8f4e-4890-ad22-944a10902e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f270cb-6750-4696-94fc-1f752a5b7ed7', 'volume_size': 1, 'image_id': '454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0342ef26cf35c71ec39abf3448099a41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b68055a7e42e4aa388e4f1ecac9004db', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfaac4d44d7d775b3a3f44db920834d3eb2eb64e1a0a587bda9a323f81196d6f1130539d8362253ddcc4cc7546f7109d5db965bd2563bae6789af019311dc59e', 'id': '454d37ca-4a29-4f5b-b7f7-0fb511981ad1', 'created_at': datetime.datetime(2026, 8, 28, 18, 30, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 30, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/454d37ca-4a29-4f5b-b7f7-0fb511981ad1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f772b5-344d-4545-8b99-a3bff095ff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:52 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:52 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Volume volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 (14f270cb-6750-4696-94fc-1f752a5b7ed7): created successfully Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f772b5-344d-4545-8b99-a3bff095ff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Flow 'volume_create_manager' (1684dc86-f252-4df7-9033-3bff7d9f3bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-39d6803b-58c8-42c4-8ab1-9057ee5f0b28 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Created volume successfully. Aug 28 20:30:53 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe 1073741824" returned: 0 in 0.579s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:53 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe Aug 28 20:30:53 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:53 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.405s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Deleted volume successfully. Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7196bf4e-b771-4e9c-a01d-66aa8476f0e7 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-0b80fcc8-0a26-4ed6-bf6f-09d4bc1f8f8c-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Acquiring lock "cinder-14f270cb-6750-4696-94fc-1f752a5b7ed7-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Lock "cinder-14f270cb-6750-4696-94fc-1f752a5b7ed7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Acquiring lock "cinder-quobyte-14f270cb-6750-4696-94fc-1f752a5b7ed7" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Lock "cinder-quobyte-14f270cb-6750-4696-94fc-1f752a5b7ed7" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[42887dd7-f43d-42db-a931-d492719664ce]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:53 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe" returned: 0 in 0.289s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.859s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482102077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79750e00-5f8e-4f9e-8634-64d427db559e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:51Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Creating volume 79750e00-5f8e-4f9e-8634-64d427db559e {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:53 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32bb572-d4ac-4c06-8f5e-4dfe3335024b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dabcc93-b590-47a6-a201-ce14bd652cfe', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:53 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e 1073741824 Aug 28 20:30:53 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b943b598-bc29-48d7-8dfa-c6fab4698ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:53 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume volume-7dabcc93-b590-47a6-a201-ce14bd652cfe (7dabcc93-b590-47a6-a201-ce14bd652cfe): created successfully Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b943b598-bc29-48d7-8dfa-c6fab4698ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (3fbffb97-5a1d-4613-9688-649f72af108c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4e63ee36-3fb3-426d-b466-18eeb7bc019b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created volume successfully. Aug 28 20:30:53 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 Aug 28 20:30:53 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-00258e94-e44f-43ca-8c3c-72571621ade6-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-00258e94-e44f-43ca-8c3c-72571621ade6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-quobyte-00258e94-e44f-43ca-8c3c-72571621ade6" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-00258e94-e44f-43ca-8c3c-72571621ade6" acquired by "delete_volume" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[54db63cf-dce5-492d-8103-d8736f8912c0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:53 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7" returned: 0 in 0.440s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:53 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7 Aug 28 20:30:53 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:54 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6 Aug 28 20:30:54 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:54 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e 1073741824" returned: 0 in 0.611s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:54 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e Aug 28 20:30:54 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:54 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-14f270cb-6750-4696-94fc-1f752a5b7ed7" returned: 0 in 0.301s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Lock "cinder-quobyte-14f270cb-6750-4696-94fc-1f752a5b7ed7" released by "delete_volume" :: held 0.788s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Created reservations ['2be8e678-42ea-4451-96b7-3c0dff3f108d', '4769223e-e15f-4c75-9253-5c96dadce30b', 'b4b99442-fbcf-465b-baab-f30c80f2e9a4', '886a0dba-4464-4a0c-8f98-f3dcd999f9d2'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:54 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6" returned: 0 in 0.519s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:54 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6 Aug 28 20:30:54 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:54 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:54 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:54 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e" returned: 0 in 0.343s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.454s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-534590589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09286f4-efae-4e20-9396-1173eae1ce6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f4788f956a405db605099a1ea78e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:52Z,use_quota=True,user_id='df90cb3ef12a41d283eebcf1e7b14fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Creating volume e09286f4-efae-4e20-9396-1173eae1ce6c {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:54 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edea56e2-f2c4-463e-8492-4fca005e20df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79750e00-5f8e-4f9e-8634-64d427db559e', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1230ef-e95b-4d57-9e63-ea60b981e246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:54 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c 1073741824 Aug 28 20:30:54 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:54 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume volume-79750e00-5f8e-4f9e-8634-64d427db559e (79750e00-5f8e-4f9e-8634-64d427db559e): created successfully Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1230ef-e95b-4d57-9e63-ea60b981e246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (389bbf1d-1e3e-4fd3-98c4-57080bd07fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9c6f77be-962b-4f5a-9492-a21bae90b67b tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created volume successfully. Aug 28 20:30:54 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-00258e94-e44f-43ca-8c3c-72571621ade6" returned: 0 in 0.379s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-00258e94-e44f-43ca-8c3c-72571621ade6" released by "delete_volume" :: held 0.974s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created reservations ['61f5e671-e0f9-4243-b5a0-4b4198b9d58e', '43aab6eb-3075-49a0-8227-2486ddb0d5e1', '0e214ab2-98c2-4ba5-b141-0a11895894a5', '5202454f-61c3-4394-a7ed-a10a2568525b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:54 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.544s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Deleted volume successfully. Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b6a2d215-711d-4263-8638-d71d864491e3 tempest-VolumeAndVolumeTypeFromImageTest-904199003 None] Lock "cinder-14f270cb-6750-4696-94fc-1f752a5b7ed7-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:55 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:55 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:55 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c 1073741824" returned: 0 in 0.749s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:55 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c Aug 28 20:30:55 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:55 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.385s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Deleted volume successfully. Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-ff237949-26f4-414b-a095-9e5abe2057a2 tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-00258e94-e44f-43ca-8c3c-72571621ade6-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (e80fddc4-da58-467a-8532-3f18a7e28f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:55 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33645d0-0bf7-4dc2-aef8-95cab13c9a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c" returned: 0 in 0.341s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33645d0-0bf7-4dc2-aef8-95cab13c9a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1605514435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb1fba0-10db-4805-9dcc-5000208626d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:56Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7399a73-37b3-4a8d-990d-f57f1592e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7399a73-37b3-4a8d-990d-f57f1592e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdf581d-018f-42d3-9f22-a9fe048b4ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdf581d-018f-42d3-9f22-a9fe048b4ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb1fba0-10db-4805-9dcc-5000208626d9', 'volume_name': 'volume-0bb1fba0-10db-4805-9dcc-5000208626d9', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f7aa7c-7252-41e0-97d4-3686b797544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f7aa7c-7252-41e0-97d4-3686b797544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2668c6a5-7019-47fc-bf37-4c989b16aaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:55 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Volume 0bb1fba0-10db-4805-9dcc-5000208626d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb1fba0-10db-4805-9dcc-5000208626d9', 'volume_size': 1} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1605514435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb1fba0-10db-4805-9dcc-5000208626d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:30:56Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Creating volume 0bb1fba0-10db-4805-9dcc-5000208626d9 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:30:55 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b45f33-7c25-4055-9d01-8eb0e56f8f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09286f4-efae-4e20-9396-1173eae1ce6c', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:55 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 1073741824 Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15cebd8-e2f0-419d-9fe3-c013b020b099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:55 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:55 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Volume volume-e09286f4-efae-4e20-9396-1173eae1ce6c (e09286f4-efae-4e20-9396-1173eae1ce6c): created successfully Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15cebd8-e2f0-419d-9fe3-c013b020b099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Flow 'volume_create_manager' (56d5c654-e6f9-4dcf-9e33-2b10f6923ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-baf7b909-f75f-4b05-ac95-3f21ca9e49ce tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created volume successfully. Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-7c7e291c-d8ed-44e0-9fec-d90902f81b26-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-7c7e291c-d8ed-44e0-9fec-d90902f81b26-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "cinder-quobyte-7c7e291c-d8ed-44e0-9fec-d90902f81b26" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-7c7e291c-d8ed-44e0-9fec-d90902f81b26" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e2d4ba-6c91-4a94-9de3-aca7a53975e8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:56 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26 Aug 28 20:30:56 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:56 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 1073741824" returned: 0 in 0.513s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:56 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 Aug 28 20:30:56 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:56 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9" returned: 0 in 0.279s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:56 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26" returned: 0 in 0.495s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2668c6a5-7019-47fc-bf37-4c989b16aaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb1fba0-10db-4805-9dcc-5000208626d9', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:56 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26 Aug 28 20:30:56 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8882eac1-298c-4876-b9e5-2c42b73614fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-e09286f4-efae-4e20-9396-1173eae1ce6c-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:56 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Volume volume-0bb1fba0-10db-4805-9dcc-5000208626d9 (0bb1fba0-10db-4805-9dcc-5000208626d9): created successfully Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8882eac1-298c-4876-b9e5-2c42b73614fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (e80fddc4-da58-467a-8532-3f18a7e28f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-e09286f4-efae-4e20-9396-1173eae1ce6c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:56 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f41d7f3d-4acf-40d8-91d0-1c24f8d09c7f tempest-ProjectMemberTests-1460928951 None] Created volume successfully. Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-quobyte-e09286f4-efae-4e20-9396-1173eae1ce6c" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-e09286f4-efae-4e20-9396-1173eae1ce6c" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1fad8e-76fe-49bd-9b51-8f7da68fef25]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:56 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7c7e291c-d8ed-44e0-9fec-d90902f81b26" returned: 0 in 0.299s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-quobyte-7c7e291c-d8ed-44e0-9fec-d90902f81b26" released by "delete_volume" :: held 0.859s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:57 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c Aug 28 20:30:57 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Created reservations ['5b92af80-7ed8-441b-ac3f-f81c01f08862', 'a0b15a02-4a7b-40e8-9173-c1e05eb90ad5', '7fd2c866-38cd-4696-b04d-4bc39a3d4516', '23071cfb-0218-4e02-9568-66af19367fc3'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:57 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:57 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:57 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c" returned: 0 in 0.442s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:57 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c Aug 28 20:30:57 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:57 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.296s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:57 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Deleted volume successfully. Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-89d7141c-d046-4158-b537-bb0d7cc3b2da tempest-CreateVolumesFromSourceVolumeTest-1558733717 None] Lock "cinder-7c7e291c-d8ed-44e0-9fec-d90902f81b26-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:57 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e09286f4-efae-4e20-9396-1173eae1ce6c" returned: 0 in 0.322s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-e09286f4-efae-4e20-9396-1173eae1ce6c" released by "delete_volume" :: held 0.818s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created reservations ['72b3d6fa-b4dd-453f-9a35-7ca4ea7100a0', '5b69b631-fc2f-4bdd-9198-f948d7bc4137', '84a4b8c4-bd51-49d2-a8fe-d2dfb97d1868', '85c73ee9-b85c-4fa8-a7cd-f046c7430ab1'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:57 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:57 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-79750e00-5f8e-4f9e-8634-64d427db559e-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-79750e00-5f8e-4f9e-8634-64d427db559e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-quobyte-79750e00-5f8e-4f9e-8634-64d427db559e" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-79750e00-5f8e-4f9e-8634-64d427db559e" acquired by "delete_volume" :: waited 0.041s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeb9391-3620-455f-867a-eb2a2a5698d8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:58 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e Aug 28 20:30:58 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:58 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.558s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:58 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Deleted volume successfully. Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7289e9be-4e06-4baf-8b23-c259273ba385 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-e09286f4-efae-4e20-9396-1173eae1ce6c-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Creating offline snapshot 3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 of volume 0bb1fba0-10db-4805-9dcc-5000208626d9 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10530ef-c099-4a86-8dec-718acf14063b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:58 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e" returned: 0 in 0.527s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:58 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e Aug 28 20:30:58 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:58 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 Aug 28 20:30:58 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:59 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-79750e00-5f8e-4f9e-8634-64d427db559e" returned: 0 in 0.315s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-79750e00-5f8e-4f9e-8634-64d427db559e" released by "delete_volume" :: held 0.920s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:59 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9" returned: 0 in 0.465s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:59 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 1G Aug 28 20:30:59 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created reservations ['fc86eea4-931f-4b04-8726-15abb0e40f15', 'fa737dc8-f8f0-44c7-8c3c-b3a5dbb3c1e4', 'a6bfa290-81e8-4422-b920-6fb6422243f7', 'f6aa8ce3-ff1f-4482-9fa6-c7debedf2408'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:59 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:30:59 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:59 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.300s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:30:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Deleted volume successfully. Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8acda722-6d85-41b0-b7b4-bde71a7bec13 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-79750e00-5f8e-4f9e-8634-64d427db559e-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:30:59 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 1G" returned: 0 in 0.564s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb1fba0-10db-4805-9dcc-5000208626d9 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:30:59 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb1fba0-10db-4805-9dcc-5000208626d9 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 Aug 28 20:30:59 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:30:59 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bb1fba0-10db-4805-9dcc-5000208626d9 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2" returned: 0 in 0.315s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:30:59 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 is being set with open permissions: ugo+rw Aug 28 20:30:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:00 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 Aug 28 20:31:00 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:00 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2" returned: 0 in 0.303s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-7dabcc93-b590-47a6-a201-ce14bd652cfe-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:00 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.info Aug 28 20:31:00 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-7dabcc93-b590-47a6-a201-ce14bd652cfe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-quobyte-7dabcc93-b590-47a6-a201-ce14bd652cfe" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-7dabcc93-b590-47a6-a201-ce14bd652cfe" acquired by "delete_volume" :: waited 0.036s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Flow 'volume_create_manager' (77ac8a0a-9e9b-4dc1-b372-835e58120703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc456647-b087-44bd-8a38-9b9922960798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef3826b-81fc-40d8-86d4-ada487dab04b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc456647-b087-44bd-8a38-9b9922960798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2108828969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557981e7-a727-4f92-9092-2c4c84892349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14eba76af009436eb44a734f33ff4cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:00Z,use_quota=True,user_id='c490719d7c09439bb4a806c17c97086b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fbf5c9-ea5f-437f-bef8-cb1429ea79a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fbf5c9-ea5f-437f-bef8-cb1429ea79a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377a7795-d664-4bb3-b820-0a8f4db8e0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377a7795-d664-4bb3-b820-0a8f4db8e0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557981e7-a727-4f92-9092-2c4c84892349', 'volume_name': 'volume-557981e7-a727-4f92-9092-2c4c84892349', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bd8808-73d3-4c22-ae3b-30734b76fc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bd8808-73d3-4c22-ae3b-30734b76fc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba79807-6203-4d93-9cee-7b6c9194be30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:00 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Volume 557981e7-a727-4f92-9092-2c4c84892349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557981e7-a727-4f92-9092-2c4c84892349', 'volume_size': 1} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:00 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.info" returned: 0 in 0.335s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:00 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.info is being set with open permissions: ugo+rw Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:00 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe Aug 28 20:31:00 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:00 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.info Aug 28 20:31:00 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:00 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:00 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.info" returned: 0 in 0.274s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2108828969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557981e7-a727-4f92-9092-2c4c84892349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14eba76af009436eb44a734f33ff4cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:00Z,use_quota=True,user_id='c490719d7c09439bb4a806c17c97086b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Creating volume 557981e7-a727-4f92-9092-2c4c84892349 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:00 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe" returned: 0 in 0.466s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:01 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 1073741824 Aug 28 20:31:01 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:01 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8d90652a-3349-45a9-bcf0-08c72013d4b1 tempest-ProjectMemberTests-1460928951 None] Create snapshot completed successfully Aug 28 20:31:01 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe Aug 28 20:31:01 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:01 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-7dabcc93-b590-47a6-a201-ce14bd652cfe" returned: 0 in 0.274s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-7dabcc93-b590-47a6-a201-ce14bd652cfe" released by "delete_volume" :: held 0.811s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created reservations ['2d0c1585-6253-4d40-8d1a-d7d11629df52', '7645bb25-298d-4787-8f22-9d1ee88c8a2b', '384b0ac0-ff0f-4e6f-9600-42a3db018787', 'd1f1bfd5-b403-42ca-9e94-2944775b5ead'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:01 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:01 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:01 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 1073741824" returned: 0 in 0.539s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-b0c52120-a8e2-44b1-919e-6593c20c9fdf-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:01 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-b0c52120-a8e2-44b1-919e-6593c20c9fdf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:01 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-quobyte-b0c52120-a8e2-44b1-919e-6593c20c9fdf" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-b0c52120-a8e2-44b1-919e-6593c20c9fdf" acquired by "delete_volume" :: waited 0.044s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe57d8c-ae80-4fdf-8daf-024dc2e2fe77]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:01 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.350s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-3d2d089a-8b5d-4489-aea5-706c5ab3d8a2-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:01 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Deleted volume successfully. Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Lock "cinder-3d2d089a-8b5d-4489-aea5-706c5ab3d8a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-0bb1fba0-10db-4805-9dcc-5000208626d9" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-391c3d8f-7175-4aa5-8857-ef48647a77be tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-7dabcc93-b590-47a6-a201-ce14bd652cfe-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0bb1fba0-10db-4805-9dcc-5000208626d9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-3d2d089a-8b5d-4489-aea5-706c5ab3d8a2" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:01 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf Aug 28 20:31:01 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-3d2d089a-8b5d-4489-aea5-706c5ab3d8a2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Deleting offline snapshot 3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 of volume 0bb1fba0-10db-4805-9dcc-5000208626d9 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] snapshot_file for this snap is: volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:31:01 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349" returned: 0 in 0.380s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5be508d-26cd-4858-8732-94fce12bc9f9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba79807-6203-4d93-9cee-7b6c9194be30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557981e7-a727-4f92-9092-2c4c84892349', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:01 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668119b1-dadb-4bca-8791-60f3f102310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:02 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Volume volume-557981e7-a727-4f92-9092-2c4c84892349 (557981e7-a727-4f92-9092-2c4c84892349): created successfully Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668119b1-dadb-4bca-8791-60f3f102310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Flow 'volume_create_manager' (77ac8a0a-9e9b-4dc1-b372-835e58120703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-579b4bd7-2751-44f8-a915-c7f7bec8c1ec tempest-VolumeDependencyTests-737016121 None] Created volume successfully. Aug 28 20:31:02 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 Aug 28 20:31:02 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:02 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf" returned: 0 in 0.429s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:02 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf Aug 28 20:31:02 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:02 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2" returned: 0 in 0.421s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bb1fba0-10db-4805-9dcc-5000208626d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[46742c01-59d9-4a6b-a291-d85fb583bc24]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:02 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b0c52120-a8e2-44b1-919e-6593c20c9fdf" returned: 0 in 0.276s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-b0c52120-a8e2-44b1-919e-6593c20c9fdf" released by "delete_volume" :: held 0.761s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created reservations ['008dea3f-d466-4cc6-b3ac-8c364a6d7b3d', '85f21d0a-26e7-4980-ab3b-d1fcb923764f', '7a876fde-0d12-49f1-a757-c19da64153a1', 'cc722a83-4afb-4a9c-8270-1a15146c5410'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:02 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 Aug 28 20:31:02 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:02 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:02 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Creating offline snapshot f42bd06e-fa18-4c0c-9269-1ad6d70cec5d of volume 557981e7-a727-4f92-9092-2c4c84892349 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[625e34a3-973b-4b99-81c3-8d25a95bca4a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-72619dee-991d-4cb1-9e1b-bd26adb4c66b-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-72619dee-991d-4cb1-9e1b-bd26adb4c66b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:02 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9" returned: 0 in 0.528s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:02 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 Aug 28 20:31:02 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:02 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 Aug 28 20:31:03 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-quobyte-72619dee-991d-4cb1-9e1b-bd26adb4c66b" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-72619dee-991d-4cb1-9e1b-bd26adb4c66b" acquired by "delete_volume" :: waited 0.034s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed067cf-576c-4214-b2c8-f797d6e960af]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:03 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.425s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:03 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Deleted volume successfully. Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d14b9bd5-1779-41ca-8591-02a296bb01d2 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-b0c52120-a8e2-44b1-919e-6593c20c9fdf-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:03 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b Aug 28 20:31:03 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:03 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349" returned: 0 in 0.459s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:03 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d 1G Aug 28 20:31:03 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:03 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2" returned: 0 in 0.508s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:03 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2 Aug 28 20:31:03 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:03 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b" returned: 0 in 0.483s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:03 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b Aug 28 20:31:03 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:03 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9.3d2d089a-8b5d-4489-aea5-706c5ab3d8a2" returned: 0 in 0.302s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:03 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d 1G" returned: 0 in 0.552s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557981e7-a727-4f92-9092-2c4c84892349 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-3d2d089a-8b5d-4489-aea5-706c5ab3d8a2" released by "_delete_snapshot" :: held 1.948s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0bb1fba0-10db-4805-9dcc-5000208626d9" released by "delete_snapshot" :: held 1.984s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:03 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557981e7-a727-4f92-9092-2c4c84892349 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d Aug 28 20:31:03 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:03 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-72619dee-991d-4cb1-9e1b-bd26adb4c66b" returned: 0 in 0.353s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-72619dee-991d-4cb1-9e1b-bd26adb4c66b" released by "delete_volume" :: held 0.894s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:03 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Created reservations ['94e0266b-df20-438c-a854-ef9d9a8ce8f6', 'b8577417-775f-4994-b6ff-e9dec01a6116', '44d74c0f-f6c1-4a27-8109-fb9bdfe018d4', '4880f6b6-03ad-40ee-9f1f-3095a50d211c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created reservations ['d7319363-44f4-464e-971c-9ba1f993cb00', '88df2b00-7484-4d31-837e-356e2a30d24d', '96cc9cd6-cd0a-4d24-9de4-27cfffb22f42', '1bf8645d-b592-48de-96c0-cc6747153ee5'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:04 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Delete snapshot completed successfully. Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5ab0500d-4310-49c0-bf8a-ac29e83990bd tempest-ProjectMemberTests-1460928951 None] Lock "cinder-3d2d089a-8b5d-4489-aea5-706c5ab3d8a2-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:04 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:04 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:04 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557981e7-a727-4f92-9092-2c4c84892349 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d" returned: 0 in 0.352s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:04 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d is being set with open permissions: ugo+rw Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:04 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d Aug 28 20:31:04 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:04 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.283s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:04 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Deleted volume successfully. Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3fb8ce66-9179-48a5-9e49-aa4745a69884 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-72619dee-991d-4cb1-9e1b-bd26adb4c66b-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:04 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d" returned: 0 in 0.292s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:04 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.info Aug 28 20:31:04 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:04 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.info" returned: 0 in 0.260s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:04 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.info is being set with open permissions: ugo+rw Aug 28 20:31:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:04 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.info Aug 28 20:31:04 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:05 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.info" returned: 0 in 0.256s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-0bb1fba0-10db-4805-9dcc-5000208626d9-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Lock "cinder-0bb1fba0-10db-4805-9dcc-5000208626d9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:05 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2d7c5b7b-6dcd-4019-9ecc-106921fd83c4 tempest-VolumeDependencyTests-737016121 None] Create snapshot completed successfully Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-0bb1fba0-10db-4805-9dcc-5000208626d9" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0bb1fba0-10db-4805-9dcc-5000208626d9" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-47db308f-e16c-4bdc-982a-159575d5ae9c-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-47db308f-e16c-4bdc-982a-159575d5ae9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-quobyte-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[708fb3bd-7ac9-4839-9778-7efdfa7f13b9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-quobyte-47db308f-e16c-4bdc-982a-159575d5ae9c" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-47db308f-e16c-4bdc-982a-159575d5ae9c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Deleting offline snapshot 47db308f-e16c-4bdc-982a-159575d5ae9c of volume a5d8f47e-bc0f-4689-84b3-192fcb80eac0 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] snapshot_file for this snap is: volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[423380b2-c03d-4f96-90bf-ff52f43653b4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:05 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 Aug 28 20:31:05 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:05 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c Aug 28 20:31:05 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:05 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9" returned: 0 in 0.391s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:05 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9 Aug 28 20:31:05 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:05 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c" returned: 0 in 0.391s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd4f301-788f-4e2c-9d0d-3c8a2d446b1b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:05 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 Aug 28 20:31:05 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:05 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0bb1fba0-10db-4805-9dcc-5000208626d9" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0bb1fba0-10db-4805-9dcc-5000208626d9" released by "delete_volume" :: held 0.789s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Created reservations ['b309f1ef-bdb1-4bb7-94e2-e097c253d568', 'c825aa38-3bf9-4775-bd35-9b8a97c3f3d6', '464c1c45-d37f-4977-9c47-b11bac40e01e', '0e01d95c-aa48-4dbd-a3bd-49a4d8f2813c'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:06 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:06 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:06 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" returned: 0 in 0.461s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:06 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c Aug 28 20:31:06 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:06 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.393s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:06 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Deleted volume successfully. Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-205c5ead-190a-45b6-ab9c-061fb7cc137a tempest-ProjectMemberTests-1460928951 None] Lock "cinder-0bb1fba0-10db-4805-9dcc-5000208626d9-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:06 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c" returned: 0 in 0.404s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:06 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c Aug 28 20:31:06 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:06 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:06 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Flow 'volume_create_manager' (ff109c53-25d9-40d5-867d-c8c92a57e0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b784dfd-da34-4276-9ab1-49c53f844cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:06 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0.47db308f-e16c-4bdc-982a-159575d5ae9c" returned: 0 in 0.368s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b784dfd-da34-4276-9ab1-49c53f844cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1722867061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c4bbc1-f828-4ec2-a193-3a48e8eee2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14eba76af009436eb44a734f33ff4cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f42bd06e-fa18-4c0c-9269-1ad6d70cec5d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:07Z,use_quota=True,user_id='c490719d7c09439bb4a806c17c97086b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d0439a-c8bf-4d2d-9f5b-2798c57f303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d0439a-c8bf-4d2d-9f5b-2798c57f303e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b91300f-4dae-4fd7-ad4f-ad4a3c9662e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b91300f-4dae-4fd7-ad4f-ad4a3c9662e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40c4bbc1-f828-4ec2-a193-3a48e8eee2a3', 'volume_name': 'volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3', 'volume_size': 1, 'snapshot_id': 'f42bd06e-fa18-4c0c-9269-1ad6d70cec5d'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd815d0f-3d39-47c7-ab1e-fcfaaf97dff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd815d0f-3d39-47c7-ab1e-fcfaaf97dff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d65bfb-33d3-47a0-8a19-d2c368d350ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:07 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Volume 40c4bbc1-f828-4ec2-a193-3a48e8eee2a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3', 'volume_size': 1, 'snapshot_id': 'f42bd06e-fa18-4c0c-9269-1ad6d70cec5d'} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Acquiring lock "cinder-quobyte-f42bd06e-fa18-4c0c-9269-1ad6d70cec5d-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" by "_create_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-47db308f-e16c-4bdc-982a-159575d5ae9c" released by "_delete_snapshot" :: held 1.817s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" released by "delete_snapshot" :: held 1.843s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-f42bd06e-fa18-4c0c-9269-1ad6d70cec5d-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Creating volume 40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 from snapshot f42bd06e-fa18-4c0c-9269-1ad6d70cec5d {{(pid=86028) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Acquiring lock "cinder-quobyte-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (62191b45-fb11-4877-ada4-6409dcd7d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cccfd7cf-1c26-48be-a362-79de0a6aa733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] snapshot: f42bd06e-fa18-4c0c-9269-1ad6d70cec5d, volume: 40c4bbc1-f828-4ec2-a193-3a48e8eee2a3, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:31:07 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cccfd7cf-1c26-48be-a362-79de0a6aa733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887626937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd48279-1825-4dcb-8ba7-d286ea03506e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:07Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea3b630-7c5f-48ba-9784-7787eb779ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea3b630-7c5f-48ba-9784-7787eb779ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23feb63-c434-41fd-9809-9e4120eaffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23feb63-c434-41fd-9809-9e4120eaffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd48279-1825-4dcb-8ba7-d286ea03506e', 'volume_name': 'volume-5cd48279-1825-4dcb-8ba7-d286ea03506e', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5151255-8b9a-45f9-ab58-4ca104025fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5151255-8b9a-45f9-ab58-4ca104025fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7076b4-6ac9-4d03-bc92-ff4ece74aa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:07 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Volume 5cd48279-1825-4dcb-8ba7-d286ea03506e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd48279-1825-4dcb-8ba7-d286ea03506e', 'volume_size': 1} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.364s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30b74a4-63d5-472f-ad1f-5a67e45afb02]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created reservations ['2da5760f-45ae-469c-8bb5-0f85e8b2e4a6', 'a2ef8fc6-7336-4987-b03c-dae1a16b7290', '2fc5c662-4f45-447c-8d04-da3c9006d36d', '697f7632-5f16-4aa7-9dc0-a16dd23993e3'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:07 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Delete snapshot completed successfully. Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c6bf52e8-8eb2-4a2f-b530-de9ca202ddb0 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-47db308f-e16c-4bdc-982a-159575d5ae9c-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:07 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d Aug 28 20:31:07 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-a5d8f47e-bc0f-4689-84b3-192fcb80eac0-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-a5d8f47e-bc0f-4689-84b3-192fcb80eac0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "cinder-quobyte-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdf5869-85ca-487a-bbaf-af78578fb823]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:07 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557981e7-a727-4f92-9092-2c4c84892349(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[164987b7-54a0-4ad2-9a87-9bd7957194d0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:07 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 Aug 28 20:31:07 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:07 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 Aug 28 20:31:07 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:08 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" returned: 0 in 0.400s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:08 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0 Aug 28 20:31:08 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:08 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349" returned: 0 in 0.451s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:08 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 Aug 28 20:31:08 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:08 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" returned: 0 in 0.274s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-quobyte-a5d8f47e-bc0f-4689-84b3-192fcb80eac0" released by "delete_volume" :: held 0.757s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Created reservations ['0af05b7e-9a2b-48df-9ed5-ef23da142959', '6b552daa-a9fa-4030-915d-5261ff47d198', '04a5332f-3438-467a-8ea7-fa8529406641', 'cf95d33f-3646-41d9-a36f-8ed3bca10ea3'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:08 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:08 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:08 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.353s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:08 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:08 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Deleted volume successfully. Aug 28 20:31:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fa6ce728-327f-45a4-83b6-80e2c7f299b9 tempest-CreateVolumesFromSnapshotTest-1977770439 None] Lock "cinder-a5d8f47e-bc0f-4689-84b3-192fcb80eac0-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:13 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" returned: 0 in 5.467s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:13 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:31:13 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Converted 1024.00 MB image at 187.27 MB/s Aug 28 20:31:13 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 is being set with open permissions: ugo+rw Aug 28 20:31:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:13 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 Aug 28 20:31:13 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:13 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" returned: 0 in 0.318s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" released by "_copy_volume_from_snapshot" :: held 6.822s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-f42bd06e-fa18-4c0c-9269-1ad6d70cec5d-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" released by "_create_volume_from_snapshot" :: held 6.942s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.974s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.837s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887626937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd48279-1825-4dcb-8ba7-d286ea03506e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:07Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Creating volume 5cd48279-1825-4dcb-8ba7-d286ea03506e {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:14 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:14 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e 1073741824 Aug 28 20:31:14 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d65bfb-33d3-47a0-8a19-d2c368d350ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3', 'volume_size': 1, 'snapshot_id': 'f42bd06e-fa18-4c0c-9269-1ad6d70cec5d'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faeeff3d-ee69-4324-bfec-2421d5cf5acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:14 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Volume volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 (40c4bbc1-f828-4ec2-a193-3a48e8eee2a3): created successfully Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faeeff3d-ee69-4324-bfec-2421d5cf5acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Flow 'volume_create_manager' (ff109c53-25d9-40d5-867d-c8c92a57e0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:14 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-19daca22-aaae-4be2-ba20-970bcf763ac5 tempest-VolumeDependencyTests-737016121 None] Created volume successfully. Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Acquiring lock "cinder-f42bd06e-fa18-4c0c-9269-1ad6d70cec5d-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Lock "cinder-f42bd06e-fa18-4c0c-9269-1ad6d70cec5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Acquiring lock "cinder-quobyte-557981e7-a727-4f92-9092-2c4c84892349" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-557981e7-a727-4f92-9092-2c4c84892349" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Acquiring lock "cinder-quobyte-f42bd06e-fa18-4c0c-9269-1ad6d70cec5d" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-f42bd06e-fa18-4c0c-9269-1ad6d70cec5d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Deleting offline snapshot f42bd06e-fa18-4c0c-9269-1ad6d70cec5d of volume 557981e7-a727-4f92-9092-2c4c84892349 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] snapshot_file for this snap is: volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa248daa-1836-42a5-8294-1938854b96cd]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:14 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e 1073741824" returned: 0 in 0.615s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:14 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d Aug 28 20:31:14 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:14 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e Aug 28 20:31:14 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:15 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e" returned: 0 in 0.347s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:15 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d" returned: 0 in 0.490s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557981e7-a727-4f92-9092-2c4c84892349(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7076b4-6ac9-4d03-bc92-ff4ece74aa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd48279-1825-4dcb-8ba7-d286ea03506e', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9588cc32-0b30-4c63-941a-cd9e94fcc126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[287ab953-f52a-4510-9db9-f424203adffd]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:15 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Volume volume-5cd48279-1825-4dcb-8ba7-d286ea03506e (5cd48279-1825-4dcb-8ba7-d286ea03506e): created successfully Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9588cc32-0b30-4c63-941a-cd9e94fcc126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (62191b45-fb11-4877-ada4-6409dcd7d48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:15 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8ab91450-db74-4291-a3ae-3f29826e2956 tempest-ProjectMemberTests-1460928951 None] Created volume successfully. Aug 28 20:31:15 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 Aug 28 20:31:15 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:15 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349" returned: 0 in 0.603s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:15 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:15 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d Aug 28 20:31:15 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:16 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d" returned: 0 in 0.404s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:16 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d Aug 28 20:31:16 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Creating offline snapshot 5a5ecc24-39af-423a-a082-8b6f5d6c6e05 of volume 5cd48279-1825-4dcb-8ba7-d286ea03506e {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c29da4-e764-4064-a9e7-e33abc6ab477]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:16 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349.f42bd06e-fa18-4c0c-9269-1ad6d70cec5d" returned: 0 in 0.305s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-f42bd06e-fa18-4c0c-9269-1ad6d70cec5d" released by "_delete_snapshot" :: held 1.931s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:16 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e Aug 28 20:31:16 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-557981e7-a727-4f92-9092-2c4c84892349" released by "delete_snapshot" :: held 1.967s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Created reservations ['a742446e-0732-4dfd-828f-4f9f4920e8f9', 'bae0a4f5-27de-40d4-8997-9fb268e7d786', '436451a6-9cf2-4633-84d7-8dfb8877e7d2', 'dbbe96e0-93eb-41f3-a6e4-f1f86c863db9'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Delete snapshot completed successfully. Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b5f30f7-76fc-4ad6-abd8-d0e09cec7e9d tempest-VolumeDependencyTests-737016121 None] Lock "cinder-f42bd06e-fa18-4c0c-9269-1ad6d70cec5d-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:16 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e" returned: 0 in 0.492s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:16 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 1G Aug 28 20:31:16 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:17 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 1G" returned: 0 in 0.487s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cd48279-1825-4dcb-8ba7-d286ea03506e -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:17 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cd48279-1825-4dcb-8ba7-d286ea03506e -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 Aug 28 20:31:17 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:17 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cd48279-1825-4dcb-8ba7-d286ea03506e -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05" returned: 0 in 0.313s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:17 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 is being set with open permissions: ugo+rw Aug 28 20:31:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:17 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 Aug 28 20:31:17 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:17 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05" returned: 0 in 0.326s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:18 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.info Aug 28 20:31:18 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Acquiring lock "cinder-557981e7-a727-4f92-9092-2c4c84892349-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Lock "cinder-557981e7-a727-4f92-9092-2c4c84892349-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Acquiring lock "cinder-quobyte-557981e7-a727-4f92-9092-2c4c84892349" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-557981e7-a727-4f92-9092-2c4c84892349" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9158452e-ad0a-442f-8fea-403d82e16ef7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:18 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Flow 'volume_create_manager' (cfda758e-5acf-4de2-877a-2149ace65a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea03947-8dae-454e-b1ef-a1a0ccb83366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.info" returned: 0 in 0.326s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:18 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.info is being set with open permissions: ugo+rw Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:18 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 Aug 28 20:31:18 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea03947-8dae-454e-b1ef-a1a0ccb83366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3291b8c6-95d4-47b3-87ea-0e892d238bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669793563d847ddac367d14a95d12bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:18Z,use_quota=True,user_id='9a615262818648c886804cee257d557f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:18 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.info Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46ae40b-8caf-474a-aace-f3a3fe58d45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:18 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46ae40b-8caf-474a-aace-f3a3fe58d45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ab8a8e-fd55-4fa2-9927-3eef4422c38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.image.glance [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Creating Keystone auth plugin from conf {{(pid=86028) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 28 20:31:18 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.info" returned: 0 in 0.274s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:18 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349" returned: 0 in 0.438s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:18 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8e0abb90-3b6f-4bad-a85e-afd6d10e7177 tempest-ProjectMemberTests-1460928951 None] Create snapshot completed successfully Aug 28 20:31:18 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349 Aug 28 20:31:18 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ab8a8e-fd55-4fa2-9927-3eef4422c38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3291b8c6-95d4-47b3-87ea-0e892d238bb7', 'volume_name': 'volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7', 'volume_size': 1, 'image_id': '1aece477-13dd-4330-a9d6-3a75ede98a39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1aece477-13dd-4330-a9d6-3a75ede98a39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f59eb48c63e6c8e860284b032401fe4f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b669793563d847ddac367d14a95d12bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77177db8f8cb0a6f3f6a8224eb19395fb737e6364349b0eb2d881d50c2c38a3d7f73dd860c01c56332b02b8cbbc14ff1a22255d5889403be605844716acd5c23', 'id': '1aece477-13dd-4330-a9d6-3a75ede98a39', 'created_at': datetime.datetime(2026, 8, 28, 18, 31, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 31, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1aece477-13dd-4330-a9d6-3a75ede98a39/file', 'properties': {}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12177cde-a3f1-46a3-a3a0-d10b090f9d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12177cde-a3f1-46a3-a3a0-d10b090f9d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29e6a0e-25dd-4501-b9c5-effa972c6fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:18 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Volume 3291b8c6-95d4-47b3-87ea-0e892d238bb7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7', 'volume_size': 1, 'image_id': '1aece477-13dd-4330-a9d6-3a75ede98a39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1aece477-13dd-4330-a9d6-3a75ede98a39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f59eb48c63e6c8e860284b032401fe4f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b669793563d847ddac367d14a95d12bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77177db8f8cb0a6f3f6a8224eb19395fb737e6364349b0eb2d881d50c2c38a3d7f73dd860c01c56332b02b8cbbc14ff1a22255d5889403be605844716acd5c23', 'id': '1aece477-13dd-4330-a9d6-3a75ede98a39', 'created_at': datetime.datetime(2026, 8, 28, 18, 31, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 31, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1aece477-13dd-4330-a9d6-3a75ede98a39/file', 'properties': {}}, 'image_service': } Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Trying to clone 3291b8c6-95d4-47b3-87ea-0e892d238bb7 from image 1aece477-13dd-4330-a9d6-3a75ede98a39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1aece477-13dd-4330-a9d6-3a75ede98a39', 'metadata': {}}]). {{(pid=86028) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 28 20:31:18 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Image download 0.00 MB at 0.00 MB/s Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[725632a3-349c-4089-8aa4-3a59df4cef6a]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:18 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-557981e7-a727-4f92-9092-2c4c84892349" returned: 0 in 0.271s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:18 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-557981e7-a727-4f92-9092-2c4c84892349" released by "delete_volume" :: held 0.786s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Created reservations ['f6e6c5ae-5b4b-4ef6-9eb5-9f73e73b24b9', '392f00d0-46cc-4697-8656-bf8d78836328', '8e207e4a-f81b-4650-85cf-15f0530c147b', '63b3aaf7-f9bf-4979-b32c-18fe7882c217'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:19 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD Aug 28 20:31:19 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:19 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:19 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Acquiring lock "cinder-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Lock "cinder-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Acquiring lock "cinder-quobyte-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:19 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" acquired by "delete_volume" :: waited 0.035s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:19 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b9a10a-9c10-4c74-b71c-c4774ce058d7]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.325s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:19 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Deleted volume successfully. Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-5a5ecc24-39af-423a-a082-8b6f5d6c6e05-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e0c171c-0dbb-4bb4-8723-1b174c329753 tempest-VolumeDependencyTests-737016121 None] Lock "cinder-557981e7-a727-4f92-9092-2c4c84892349-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:19 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-5a5ecc24-39af-423a-a082-8b6f5d6c6e05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:19 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-5cd48279-1825-4dcb-8ba7-d286ea03506e" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-5cd48279-1825-4dcb-8ba7-d286ea03506e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-5a5ecc24-39af-423a-a082-8b6f5d6c6e05" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-5a5ecc24-39af-423a-a082-8b6f5d6c6e05" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Deleting offline snapshot 5a5ecc24-39af-423a-a082-8b6f5d6c6e05 of volume 5cd48279-1825-4dcb-8ba7-d286ea03506e {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] snapshot_file for this snap is: volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18ea8e6-8397-4e49-b25f-90a61435294a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:19 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 Aug 28 20:31:19 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:19 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 Aug 28 20:31:19 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:19 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Temporary image 1aece477-13dd-4330-a9d6-3a75ede98a39 is fetched for user 9a615262818648c886804cee257d557f. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[884d80d9-e773-42ed-b646-9a413abd2224]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:19 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" returned: 0 in 0.512s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:19 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3 Aug 28 20:31:19 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:19 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD Aug 28 20:31:19 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:20 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05" returned: 0 in 0.455s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cd48279-1825-4dcb-8ba7-d286ea03506e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[22109c42-1d81-4fa8-a73a-44bfc73353ea]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:20 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" returned: 0 in 0.286s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Lock "cinder-quobyte-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3" released by "delete_volume" :: held 0.871s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:20 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e Aug 28 20:31:20 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:20 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Created reservations ['e02b3a69-f065-4071-8d81-c4ab73032ffe', 'e88473de-395b-4b3f-b8eb-05441598a801', '968613f0-1ae0-4b65-a036-8e4cfa4a57f1', 'f29f00fe-649e-4729-96a5-5289076a6b1b'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:20 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD Aug 28 20:31:20 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:20 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:20 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:20 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e" returned: 0 in 0.545s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:20 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 Aug 28 20:31:20 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:20 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD" returned: 1 in 0.504s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3291b8c6-95d4-47b3-87ea-0e892d238bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b669793563d847ddac367d14a95d12bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:18Z,use_quota=True,user_id='9a615262818648c886804cee257d557f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Creating volume 3291b8c6-95d4-47b3-87ea-0e892d238bb7 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:20 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:20 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.354s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:20 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 1073741824 Aug 28 20:31:20 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:20 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Deleted volume successfully. Aug 28 20:31:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-96ff803a-f2ca-4fa5-aa27-d78e6224024a tempest-VolumeDependencyTests-737016121 None] Lock "cinder-40c4bbc1-f828-4ec2-a193-3a48e8eee2a3-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:21 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05" returned: 0 in 0.419s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:21 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05 Aug 28 20:31:21 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:21 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 1073741824" returned: 0 in 0.512s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:21 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 Aug 28 20:31:21 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:21 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e.5a5ecc24-39af-423a-a082-8b6f5d6c6e05" returned: 0 in 0.307s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-5a5ecc24-39af-423a-a082-8b6f5d6c6e05" released by "_delete_snapshot" :: held 1.872s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-5cd48279-1825-4dcb-8ba7-d286ea03506e" released by "delete_snapshot" :: held 1.901s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Created reservations ['c2a32b9f-084d-482e-9e93-8c5c9b40617f', '4d585315-4bd2-487e-8070-3bc8ea108059', '9bca8173-d8bc-4aef-a2fc-1d539b4acc88', '36701119-93d0-4633-b132-0544fa1fd679'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Delete snapshot completed successfully. Aug 28 20:31:21 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-74ef5885-2113-4cee-93c3-54af1819d5f1 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-5a5ecc24-39af-423a-a082-8b6f5d6c6e05-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7" returned: 0 in 0.289s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Attempting download of 1aece477-13dd-4330-a9d6-3a75ede98a39 ((None, [{'url': 'file:///opt/stack/data/glance/images/1aece477-13dd-4330-a9d6-3a75ede98a39', 'metadata': {}}])) to volume 3291b8c6-95d4-47b3-87ea-0e892d238bb7. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df808e5-5d61-4917-8bb0-9ba7aa940e6a]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1aece477-13dd-4330-a9d6-3a75ede98a39_c8hyllol {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-5cd48279-1825-4dcb-8ba7-d286ea03506e-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-5cd48279-1825-4dcb-8ba7-d286ea03506e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-5cd48279-1825-4dcb-8ba7-d286ea03506e" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-5cd48279-1825-4dcb-8ba7-d286ea03506e" acquired by "delete_volume" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:21 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1aece477-13dd-4330-a9d6-3a75ede98a39_c8hyllol Aug 28 20:31:21 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[db68e5ed-29e6-4b46-9712-d7585202d2b6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:22 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e Aug 28 20:31:22 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:22 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1aece477-13dd-4330-a9d6-3a75ede98a39_c8hyllol" returned: 0 in 0.532s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1aece477-13dd-4330-a9d6-3a75ede98a39_c8hyllol {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:22 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1aece477-13dd-4330-a9d6-3a75ede98a39_c8hyllol Aug 28 20:31:22 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:22 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e" returned: 0 in 0.513s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:22 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e Aug 28 20:31:22 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:22 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1aece477-13dd-4330-a9d6-3a75ede98a39_c8hyllol" returned: 1 in 0.461s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1aece477-13dd-4330-a9d6-3a75ede98a39_c8hyllol' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47fff27-f87f-4ceb-9c6a-93d8f716a92b]: (4, 'raw') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:22 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5cd48279-1825-4dcb-8ba7-d286ea03506e" returned: 0 in 0.338s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:22 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD Aug 28 20:31:22 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-5cd48279-1825-4dcb-8ba7-d286ea03506e" released by "delete_volume" :: held 0.929s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Created reservations ['d30adcf2-0033-449d-8dc0-63a43e208df2', 'decc119a-a200-4002-a8ec-64e5916b6ab3', '662d1968-7788-4e0a-86dd-3162e1213553', '783fdbdc-9d7b-43fd-906f-dc8868388391'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:23 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:23 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:23 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:23 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD Aug 28 20:31:23 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:23 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.286s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:23 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:23 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Deleted volume successfully. Aug 28 20:31:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d4a869ad-3b83-41c6-8000-32d3ebc137b8 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-5cd48279-1825-4dcb-8ba7-d286ea03506e-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:23 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 28 20:31:23 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] 1aece477-13dd-4330-a9d6-3a75ede98a39 was raw, converting to qcow2 {{(pid=86028) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 28 20:31:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:23 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 Aug 28 20:31:23 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:23 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Flow 'volume_create_manager' (80e63c54-a215-4be8-b952-86e0d5f53cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237f2dd4-5a11-443a-ba08-6728c4400806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237f2dd4-5a11-443a-ba08-6728c4400806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43d5314-5b11-4733-892d-a7ff55df7474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49626a3316d4230a435b0cd5d4ea7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:24Z,use_quota=True,user_id='b9ed23fddf634f9eb48acf5aa34dea9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:24 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdc6f8c-ac3f-47fd-9fa0-41bd5d7d69b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdc6f8c-ac3f-47fd-9fa0-41bd5d7d69b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bd8a05-ca97-4ee6-a7d2-b070487b7b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bd8a05-ca97-4ee6-a7d2-b070487b7b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43d5314-5b11-4733-892d-a7ff55df7474', 'volume_name': 'volume-b43d5314-5b11-4733-892d-a7ff55df7474', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143d4502-e762-4967-a371-b632a05378d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143d4502-e762-4967-a371-b632a05378d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfa5b63-0c3b-4558-92c3-1755abb119d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Volume b43d5314-5b11-4733-892d-a7ff55df7474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43d5314-5b11-4733-892d-a7ff55df7474', 'volume_size': 1} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43d5314-5b11-4733-892d-a7ff55df7474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49626a3316d4230a435b0cd5d4ea7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:24Z,use_quota=True,user_id='b9ed23fddf634f9eb48acf5aa34dea9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Creating volume b43d5314-5b11-4733-892d-a7ff55df7474 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:24 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7" returned: 0 in 0.675s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1aece477-13dd-4330-a9d6-3a75ede98a39_dls2o_jrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:31:24 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Converted 0.00 MB image at 0.00 MB/s Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:24 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474 1073741824 Aug 28 20:31:24 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:24 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 1G Aug 28 20:31:24 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:24 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 1G" returned: 0 in 0.437s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Downloaded image 1aece477-13dd-4330-a9d6-3a75ede98a39 ((None, [{'url': 'file:///opt/stack/data/glance/images/1aece477-13dd-4330-a9d6-3a75ede98a39', 'metadata': {}}])) to volume 3291b8c6-95d4-47b3-87ea-0e892d238bb7 successfully. {{(pid=86028) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Temporary image 1aece477-13dd-4330-a9d6-3a75ede98a39 for user 9a615262818648c886804cee257d557f is deleted. {{(pid=86028) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.volume_utils [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Marking volume 3291b8c6-95d4-47b3-87ea-0e892d238bb7 as bootable. {{(pid=86028) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Copying metadata from image 1aece477-13dd-4330-a9d6-3a75ede98a39 to 3291b8c6-95d4-47b3-87ea-0e892d238bb7. {{(pid=86028) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Creating volume glance metadata for volume 3291b8c6-95d4-47b3-87ea-0e892d238bb7 backed by image 1aece477-13dd-4330-a9d6-3a75ede98a39 with: {'image_id': '1aece477-13dd-4330-a9d6-3a75ede98a39', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f59eb48c63e6c8e860284b032401fe4f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86028) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 28 20:31:24 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (21b2f750-2afd-43bc-b13a-d4f3f1075750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb951df5-fab0-466f-b7f5-115a726a5e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474 1073741824" returned: 0 in 0.589s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb951df5-fab0-466f-b7f5-115a726a5e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977178819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:25Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7aac27-0955-4047-9f6f-6936f1f451fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7aac27-0955-4047-9f6f-6936f1f451fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be65a53a-6976-4d23-bd6f-398ac4d82e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be65a53a-6976-4d23-bd6f-398ac4d82e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8', 'volume_name': 'volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fc4548-1ac0-4b1b-b1a1-215d4d2dbaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fc4548-1ac0-4b1b-b1a1-215d4d2dbaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10cd9bec-7d58-405a-ab08-93d9d29c43bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Volume 0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8', 'volume_size': 1} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29e6a0e-25dd-4501-b9c5-effa972c6fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7', 'volume_size': 1, 'image_id': '1aece477-13dd-4330-a9d6-3a75ede98a39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1aece477-13dd-4330-a9d6-3a75ede98a39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f59eb48c63e6c8e860284b032401fe4f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b669793563d847ddac367d14a95d12bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77177db8f8cb0a6f3f6a8224eb19395fb737e6364349b0eb2d881d50c2c38a3d7f73dd860c01c56332b02b8cbbc14ff1a22255d5889403be605844716acd5c23', 'id': '1aece477-13dd-4330-a9d6-3a75ede98a39', 'created_at': datetime.datetime(2026, 8, 28, 18, 31, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 18, 31, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1aece477-13dd-4330-a9d6-3a75ede98a39/file', 'properties': {}}, 'image_service': }' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4185a540-01a1-4a68-a5cf-5fc7ffce571e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:24 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Volume volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 (3291b8c6-95d4-47b3-87ea-0e892d238bb7): created successfully Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4185a540-01a1-4a68-a5cf-5fc7ffce571e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Flow 'volume_create_manager' (cfda758e-5acf-4de2-877a-2149ace65a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6c957d40-3c75-4794-b4f5-9752def735ed tempest-VolumeImageDependencyTests-1360960247 None] Created volume successfully. Aug 28 20:31:24 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474 Aug 28 20:31:24 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:25 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474" returned: 0 in 0.270s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.317s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977178819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:25Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Creating volume 0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:25 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfa5b63-0c3b-4558-92c3-1755abb119d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43d5314-5b11-4733-892d-a7ff55df7474', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c05efb-5c8e-4a18-90cd-3893970f730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:25 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 1073741824 Aug 28 20:31:25 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:25 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Volume volume-b43d5314-5b11-4733-892d-a7ff55df7474 (b43d5314-5b11-4733-892d-a7ff55df7474): created successfully Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c05efb-5c8e-4a18-90cd-3893970f730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Flow 'volume_create_manager' (80e63c54-a215-4be8-b952-86e0d5f53cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:25 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2a8663b5-5887-485a-a1f7-0141cfc05293 tempest-CinderUnicodeTest-920846619 None] Created volume successfully. Aug 28 20:31:25 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 1073741824" returned: 0 in 0.458s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:25 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 Aug 28 20:31:25 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Acquiring lock "cinder-3291b8c6-95d4-47b3-87ea-0e892d238bb7-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Lock "cinder-3291b8c6-95d4-47b3-87ea-0e892d238bb7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Acquiring lock "cinder-quobyte-3291b8c6-95d4-47b3-87ea-0e892d238bb7" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Lock "cinder-quobyte-3291b8c6-95d4-47b3-87ea-0e892d238bb7" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16c2964-7cce-4371-8717-32b829accbb2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:25 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" returned: 0 in 0.310s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10cd9bec-7d58-405a-ab08-93d9d29c43bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0833d9bf-7564-4822-8cce-25c2d55cf41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:25 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Volume volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 (0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8): created successfully Aug 28 20:31:25 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 Aug 28 20:31:25 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0833d9bf-7564-4822-8cce-25c2d55cf41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:25 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (21b2f750-2afd-43bc-b13a-d4f3f1075750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:25 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c4ac443e-abde-4e12-8283-96339ec1ed3d tempest-ProjectMemberTests-1460928951 None] Created volume successfully. Aug 28 20:31:26 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7" returned: 0 in 0.404s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:26 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7 Aug 28 20:31:26 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:26 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-3291b8c6-95d4-47b3-87ea-0e892d238bb7" returned: 0 in 0.274s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Lock "cinder-quobyte-3291b8c6-95d4-47b3-87ea-0e892d238bb7" released by "delete_volume" :: held 0.728s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Created reservations ['7af614b5-b620-49c6-9fc3-46861aeb4428', '79189786-a046-4ddd-96e4-366c0e40bd86', 'd6ee5599-04cb-44b6-a688-dd3652306ee8', '61088e26-d513-43b5-bdfb-3c425799c283'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Flow 'volume_create_manager' (87c359ea-1486-4491-a0b6-89a7d6188f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b75e91c-7ec2-4180-9470-4b61fff6e1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b75e91c-7ec2-4180-9470-4b61fff6e1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1110004314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a00029-c8c6-4d0e-8103-3ac612273b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49626a3316d4230a435b0cd5d4ea7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:27Z,use_quota=True,user_id='b9ed23fddf634f9eb48acf5aa34dea9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81b2b65-6600-4bdb-aaa4-3251ba54566e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81b2b65-6600-4bdb-aaa4-3251ba54566e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fa8904-def2-41d6-8ce5-7ccf465b0470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fa8904-def2-41d6-8ce5-7ccf465b0470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a00029-c8c6-4d0e-8103-3ac612273b51', 'volume_name': 'volume-22a00029-c8c6-4d0e-8103-3ac612273b51', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89f7d7b-9adf-4653-b736-061ab9be1fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89f7d7b-9adf-4653-b736-061ab9be1fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef21c809-f5d3-49db-8102-d72e5ee29c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:26 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Volume 22a00029-c8c6-4d0e-8103-3ac612273b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a00029-c8c6-4d0e-8103-3ac612273b51', 'volume_size': 1} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1110004314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a00029-c8c6-4d0e-8103-3ac612273b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49626a3316d4230a435b0cd5d4ea7a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:27Z,use_quota=True,user_id='b9ed23fddf634f9eb48acf5aa34dea9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Creating volume 22a00029-c8c6-4d0e-8103-3ac612273b51 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:26 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:26 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 1073741824 Aug 28 20:31:26 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:26 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:26 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:27 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.343s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Deleted volume successfully. Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9f47d130-5cfb-4ecd-ad6a-6b26618d633a tempest-VolumeImageDependencyTests-1360960247 None] Lock "cinder-3291b8c6-95d4-47b3-87ea-0e892d238bb7-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:27 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 1073741824" returned: 0 in 0.644s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:27 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 Aug 28 20:31:27 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:27 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51" returned: 0 in 0.271s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.802s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef21c809-f5d3-49db-8102-d72e5ee29c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a00029-c8c6-4d0e-8103-3ac612273b51', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d313a8-15fe-4644-bc08-11a21548dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Creating offline snapshot 752e56fd-7687-4966-b1db-b26eae581675 of volume 0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:31:27 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Volume volume-22a00029-c8c6-4d0e-8103-3ac612273b51 (22a00029-c8c6-4d0e-8103-3ac612273b51): created successfully Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d313a8-15fe-4644-bc08-11a21548dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Flow 'volume_create_manager' (87c359ea-1486-4491-a0b6-89a7d6188f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[52464afd-d687-457d-8a81-662bc5d1e4fa]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9b4f8ea4-22f2-4d43-88d1-5d65c56015fd tempest-CinderUnicodeTest-920846619 None] Created volume successfully. Aug 28 20:31:27 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 Aug 28 20:31:27 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:28 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" returned: 0 in 0.430s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:28 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 1G Aug 28 20:31:28 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:28 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 1G" returned: 0 in 0.527s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:28 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 Aug 28 20:31:28 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:29 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675" returned: 0 in 0.446s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:29 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 is being set with open permissions: ugo+rw Aug 28 20:31:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:29 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 Aug 28 20:31:29 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:29 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675" returned: 0 in 0.280s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:29 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.info Aug 28 20:31:29 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:29 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.info" returned: 0 in 0.291s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:29 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.info is being set with open permissions: ugo+rw Aug 28 20:31:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:29 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.info Aug 28 20:31:29 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:30 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.info" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.898s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:30 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Creating offline snapshot 4ceebc2d-1aa2-46e5-993c-d933f5dce3ed of volume 22a00029-c8c6-4d0e-8103-3ac612273b51 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:31:30 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8b8ea8e4-025f-4179-989d-602af4069bb5 tempest-ProjectMemberTests-1460928951 None] Create snapshot completed successfully Aug 28 20:31:30 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[384ff180-ca2e-4c53-88dd-7b2647230e84]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:30 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 Aug 28 20:31:30 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:30 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51" returned: 0 in 0.402s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:30 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed 1G Aug 28 20:31:30 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:30 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed 1G" returned: 0 in 0.474s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a00029-c8c6-4d0e-8103-3ac612273b51 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:31 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a00029-c8c6-4d0e-8103-3ac612273b51 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed Aug 28 20:31:31 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-752e56fd-7687-4966-b1db-b26eae581675-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-752e56fd-7687-4966-b1db-b26eae581675-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-752e56fd-7687-4966-b1db-b26eae581675" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-752e56fd-7687-4966-b1db-b26eae581675" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Deleting offline snapshot 752e56fd-7687-4966-b1db-b26eae581675 of volume 0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] snapshot_file for this snap is: volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d005e268-1d0b-4ab7-b75f-75f4e60577e4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:31 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a00029-c8c6-4d0e-8103-3ac612273b51 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed" returned: 0 in 0.428s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:31 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed is being set with open permissions: ugo+rw Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:31 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed Aug 28 20:31:31 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:31 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 Aug 28 20:31:31 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Flow 'volume_create_manager' (de97c271-1fe9-46e3-93bc-2930de5282b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c302a3-190a-49b5-a551-8cc3866ff9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c302a3-190a-49b5-a551-8cc3866ff9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169800798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4952af5c-55bc-41b3-a40c-ef84dbd552fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c2e25f464e9c943cd90a8800f276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:31Z,use_quota=True,user_id='26008f3ee90f4d6aa8f2e51ffe048320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee5be72-76f2-4c52-9131-b8fb1eb5761f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee5be72-76f2-4c52-9131-b8fb1eb5761f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823f777e-484e-48c1-8d44-b4fa02bc2ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823f777e-484e-48c1-8d44-b4fa02bc2ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4952af5c-55bc-41b3-a40c-ef84dbd552fa', 'volume_name': 'volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe19c94-6ded-4462-a727-edd9d5d4d6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe19c94-6ded-4462-a727-edd9d5d4d6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993ba327-a9a8-4a98-89e1-461b8a7f4976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:31 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Volume 4952af5c-55bc-41b3-a40c-ef84dbd552fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa', 'volume_size': 1} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:31 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed" returned: 0 in 0.280s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:31 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675" returned: 0 in 0.395s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:31:31 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.info Aug 28 20:31:31 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2e7e4e-8213-4dd9-ac53-c7b0b03f9973]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:31 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 Aug 28 20:31:31 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:31 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.info" returned: 0 in 0.258s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:31 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.info is being set with open permissions: ugo+rw Aug 28 20:31:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:32 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.info Aug 28 20:31:32 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:32 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" returned: 0 in 0.415s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:32 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 Aug 28 20:31:32 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:32 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.info" returned: 0 in 0.297s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169800798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4952af5c-55bc-41b3-a40c-ef84dbd552fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c2e25f464e9c943cd90a8800f276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:31Z,use_quota=True,user_id='26008f3ee90f4d6aa8f2e51ffe048320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Creating volume 4952af5c-55bc-41b3-a40c-ef84dbd552fa {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:32 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:32 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa 1073741824 Aug 28 20:31:32 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:32 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fb8e9715-289b-4ec2-a2e8-dbea2ed96637 tempest-CinderUnicodeTest-920846619 None] Create snapshot completed successfully Aug 28 20:31:32 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675" returned: 0 in 0.400s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:32 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675 Aug 28 20:31:32 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:32 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa 1073741824" returned: 0 in 0.492s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:32 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8.752e56fd-7687-4966-b1db-b26eae581675" returned: 0 in 0.295s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:32 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa Aug 28 20:31:32 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-752e56fd-7687-4966-b1db-b26eae581675" released by "_delete_snapshot" :: held 1.604s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" released by "delete_snapshot" :: held 1.627s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:32 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Created reservations ['d196154b-0d16-4a2f-afb0-4617a53a79b8', '76fe4b93-f9f7-4765-8a6a-026067575f5a', '5517da47-c54e-4684-bac8-d158bc2a34fd', '5f4fc963-0db5-48e2-ad83-b90be092e882'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Delete snapshot completed successfully. Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dfb9f079-9b90-4099-8d7f-ee63b84c9110 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-752e56fd-7687-4966-b1db-b26eae581675-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:33 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa" returned: 0 in 0.267s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993ba327-a9a8-4a98-89e1-461b8a7f4976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47f3c79-0ee8-44bd-97e2-3040222eb7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:33 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Volume volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa (4952af5c-55bc-41b3-a40c-ef84dbd552fa): created successfully Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47f3c79-0ee8-44bd-97e2-3040222eb7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Flow 'volume_create_manager' (de97c271-1fe9-46e3-93bc-2930de5282b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4b969ed0-202d-417f-a27c-6f01662dfdbc tempest-ProjectReaderTests-1347120019 None] Created volume successfully. Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Acquiring lock "cinder-4ceebc2d-1aa2-46e5-993c-d933f5dce3ed-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Lock "cinder-4ceebc2d-1aa2-46e5-993c-d933f5dce3ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Acquiring lock "cinder-quobyte-22a00029-c8c6-4d0e-8103-3ac612273b51" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Lock "cinder-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Lock "cinder-quobyte-22a00029-c8c6-4d0e-8103-3ac612273b51" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Acquiring lock "cinder-quobyte-4ceebc2d-1aa2-46e5-993c-d933f5dce3ed" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Lock "cinder-quobyte-4ceebc2d-1aa2-46e5-993c-d933f5dce3ed" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Deleting offline snapshot 4ceebc2d-1aa2-46e5-993c-d933f5dce3ed of volume 22a00029-c8c6-4d0e-8103-3ac612273b51 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] snapshot_file for this snap is: volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce648657-5131-4ee9-8414-2dfed4833131]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" acquired by "delete_volume" :: waited 0.042s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebf7d4b-6b31-40a3-bfa3-4bd73a8aac86]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:33 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed Aug 28 20:31:33 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:33 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 Aug 28 20:31:33 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Acquiring lock "cinder-4952af5c-55bc-41b3-a40c-ef84dbd552fa-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Lock "cinder-4952af5c-55bc-41b3-a40c-ef84dbd552fa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Acquiring lock "cinder-quobyte-4952af5c-55bc-41b3-a40c-ef84dbd552fa" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Lock "cinder-quobyte-4952af5c-55bc-41b3-a40c-ef84dbd552fa" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:34 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed" returned: 0 in 0.538s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22a00029-c8c6-4d0e-8103-3ac612273b51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[639aac12-71bf-4c21-956c-ed1f79b0d290]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4784e0e9-4597-440c-bc60-4e3d12b1ed54]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:34 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" returned: 0 in 0.497s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:34 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8 Aug 28 20:31:34 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:34 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa Aug 28 20:31:34 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:34 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 Aug 28 20:31:34 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:34 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" returned: 0 in 0.269s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8" released by "delete_volume" :: held 0.864s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Created reservations ['73ab4088-917d-49f0-8317-3c1716c3984c', '4ad81e4b-d47c-4f89-8407-2b9376beb75e', '8290acf9-69aa-4dac-9080-65ac17188c7e', 'd30d297e-e901-41d8-9a2e-d9af8a926299'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:34 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa" returned: 0 in 0.454s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:34 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51" returned: 0 in 0.491s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:34 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:34 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:34 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:34 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:34 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed Aug 28 20:31:34 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:34 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:34 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Deleted volume successfully. Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-aaa101b5-03bf-4768-bb68-2e184e28832e tempest-ProjectMemberTests-1460928951 None] Lock "cinder-0845d7f9-76a3-4c6a-bbc2-7dd79310cfd8-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:34 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-4952af5c-55bc-41b3-a40c-ef84dbd552fa" returned: 0 in 0.397s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Lock "cinder-quobyte-4952af5c-55bc-41b3-a40c-ef84dbd552fa" released by "delete_volume" :: held 0.919s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Created reservations ['cf8cf2ad-32ba-4c36-857f-0d35d7069980', 'b80fc9e8-eb58-4e04-9beb-cbac267652aa', '1fa44423-34e2-46dc-9f8a-76c8a0663bfe', '02eb85fc-6687-4f89-8795-0ff7ed30cfee'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:35 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed" returned: 0 in 0.499s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=244,cinder:INSERT=84,cinder:UPDATE=327,cinder:DELETE=20 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:31:35 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed Aug 28 20:31:35 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:35 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:35 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (3081dc60-7630-4d3a-9cee-728296ff3e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd37d3d-c9fb-47d9-935e-801e0079908e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd37d3d-c9fb-47d9-935e-801e0079908e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819938647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:35Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6251ca91-5ba8-4ce0-898d-60dcd3e7b95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6251ca91-5ba8-4ce0-898d-60dcd3e7b95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f49d35-bb7d-4189-a6c5-776b0042ddb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f49d35-bb7d-4189-a6c5-776b0042ddb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7', 'volume_name': 'volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e6a78c-98d1-4e1e-8889-5ce288a96ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e6a78c-98d1-4e1e-8889-5ce288a96ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da66f5f-538c-403d-ba66-31c2734af3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:35 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Volume 74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7', 'volume_size': 1} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1819938647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:35Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Creating volume 74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:35 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:35 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51.4ceebc2d-1aa2-46e5-993c-d933f5dce3ed" returned: 0 in 0.345s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=314,cinder:SELECT=232,cinder:INSERT=88,cinder:DELETE=37 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:31:35 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 1073741824 Aug 28 20:31:35 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Lock "cinder-quobyte-4ceebc2d-1aa2-46e5-993c-d933f5dce3ed" released by "_delete_snapshot" :: held 2.028s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Lock "cinder-quobyte-22a00029-c8c6-4d0e-8103-3ac612273b51" released by "delete_snapshot" :: held 2.086s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:35 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.337s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:35 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Deleted volume successfully. Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6154f6b2-c265-4bb4-8c15-6f7305f9542a tempest-ProjectReaderTests-1347120019 None] Lock "cinder-4952af5c-55bc-41b3-a40c-ef84dbd552fa-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Created reservations ['7550699a-ba32-4c62-a355-5c2588a7516f', '310ac576-4b6f-4832-9152-f04636946e73', 'f9d7b5a4-9045-4434-83c1-0308c5938963', '7b908c95-ea2d-463a-9cfa-b22fc90afb82'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:35 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Delete snapshot completed successfully. Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b19c0a7f-e348-4a8f-943e-97055e932b8b tempest-CinderUnicodeTest-920846619 None] Lock "cinder-4ceebc2d-1aa2-46e5-993c-d933f5dce3ed-delete_snapshot" released by "delete_snapshot" :: held 2.297s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:35 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 1073741824" returned: 0 in 0.496s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:35 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:35 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 Aug 28 20:31:36 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:36 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" returned: 0 in 0.277s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da66f5f-538c-403d-ba66-31c2734af3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ffb815-d4db-41f9-bb40-985d79e53c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Volume volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 (74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7): created successfully Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ffb815-d4db-41f9-bb40-985d79e53c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (3081dc60-7630-4d3a-9cee-728296ff3e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:36 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-740fc69f-76f4-44d5-9cb0-9a44b8bed946 tempest-ProjectMemberTests-1460928951 None] Created volume successfully. Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Acquiring lock "cinder-22a00029-c8c6-4d0e-8103-3ac612273b51-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Lock "cinder-22a00029-c8c6-4d0e-8103-3ac612273b51-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Acquiring lock "cinder-quobyte-22a00029-c8c6-4d0e-8103-3ac612273b51" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Lock "cinder-quobyte-22a00029-c8c6-4d0e-8103-3ac612273b51" acquired by "delete_volume" :: waited 0.030s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5150db-9b7a-4230-b4b8-fd83481f4d99]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Flow 'volume_create_manager' (9c3ea678-c98f-45f6-806b-7e8ad2bb9ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfda778d-bfa9-4069-a10d-5b87e48d0204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfda778d-bfa9-4069-a10d-5b87e48d0204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032461542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45934e1-ea29-43c1-b7aa-5ecf11abd530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c2e25f464e9c943cd90a8800f276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:37Z,use_quota=True,user_id='26008f3ee90f4d6aa8f2e51ffe048320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ab2e22-e8ee-474a-bd4f-9ffb01644607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ab2e22-e8ee-474a-bd4f-9ffb01644607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e1fcdc-4442-4d35-b1dd-2a2e887d1cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e1fcdc-4442-4d35-b1dd-2a2e887d1cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e45934e1-ea29-43c1-b7aa-5ecf11abd530', 'volume_name': 'volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd864f93-dc6e-46c0-94d1-58f45288470d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd864f93-dc6e-46c0-94d1-58f45288470d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d9b80d-8f04-4e46-b72c-7194f02d9adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:36 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Volume e45934e1-ea29-43c1-b7aa-5ecf11abd530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530', 'volume_size': 1} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032461542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45934e1-ea29-43c1-b7aa-5ecf11abd530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f4c2e25f464e9c943cd90a8800f276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:37Z,use_quota=True,user_id='26008f3ee90f4d6aa8f2e51ffe048320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Creating volume e45934e1-ea29-43c1-b7aa-5ecf11abd530 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:36 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:36 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:36 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530 1073741824 Aug 28 20:31:36 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:36 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 Aug 28 20:31:36 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:37 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51" returned: 0 in 0.454s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:37 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51 Aug 28 20:31:37 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:37 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530 1073741824" returned: 0 in 0.517s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:37 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530 Aug 28 20:31:37 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:37 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-22a00029-c8c6-4d0e-8103-3ac612273b51" returned: 0 in 0.324s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Lock "cinder-quobyte-22a00029-c8c6-4d0e-8103-3ac612273b51" released by "delete_volume" :: held 0.844s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Created reservations ['cd382493-6977-4a2a-8688-f4f912a5d9e0', '3d677e7f-f08c-4df9-8bed-ef3439ab8aff', '0f07c61d-6394-48e1-81ac-c149375acb22', '23de3636-073a-4647-a887-d809a8af8524'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:37 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:37 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:37 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Acquiring lock "cinder-b43d5314-5b11-4733-892d-a7ff55df7474-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530" returned: 0 in 0.392s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.316s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Lock "cinder-b43d5314-5b11-4733-892d-a7ff55df7474-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Creating offline snapshot 6c8fc448-20ae-4576-817a-a1e68591bab4 of volume 74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d9b80d-8f04-4e46-b72c-7194f02d9adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f7f2d7-c624-4049-8c1d-bff0c08fc932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[19df15ee-78d1-4191-86b0-bf5fe1b227ba]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:37 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:38 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Volume volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530 (e45934e1-ea29-43c1-b7aa-5ecf11abd530): created successfully Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f7f2d7-c624-4049-8c1d-bff0c08fc932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Flow 'volume_create_manager' (9c3ea678-c98f-45f6-806b-7e8ad2bb9ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c7cc93af-82f6-4173-ace6-eb7cd0529d3c tempest-ProjectReaderTests-1347120019 None] Created volume successfully. Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Acquiring lock "cinder-quobyte-b43d5314-5b11-4733-892d-a7ff55df7474" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Lock "cinder-quobyte-b43d5314-5b11-4733-892d-a7ff55df7474" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[d723a73a-0acf-47b9-81da-98204221106f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:38 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.369s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:38 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 Aug 28 20:31:38 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Deleted volume successfully. Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-86fdd2c9-6b63-416f-87d3-e636dba1173e tempest-CinderUnicodeTest-920846619 None] Lock "cinder-22a00029-c8c6-4d0e-8103-3ac612273b51-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:38 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474 Aug 28 20:31:38 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:38 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" returned: 0 in 0.432s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:38 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 1G Aug 28 20:31:38 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:38 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:38 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474 Aug 28 20:31:38 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:38 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-b43d5314-5b11-4733-892d-a7ff55df7474" returned: 0 in 0.314s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Lock "cinder-quobyte-b43d5314-5b11-4733-892d-a7ff55df7474" released by "delete_volume" :: held 0.777s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Created reservations ['f6524e29-8442-4d4a-9447-98d51106686a', 'fdc9170f-2e92-4099-a3d7-288645dce6cf', '0b57cfff-a202-4335-96c3-3d2a121b1463', '9aad2541-8103-443a-be67-f79672522bd4'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Acquiring lock "cinder-e45934e1-ea29-43c1-b7aa-5ecf11abd530-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:38 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Lock "cinder-e45934e1-ea29-43c1-b7aa-5ecf11abd530-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Acquiring lock "cinder-quobyte-e45934e1-ea29-43c1-b7aa-5ecf11abd530" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:39 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 1G" returned: 0 in 0.627s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Lock "cinder-quobyte-e45934e1-ea29-43c1-b7aa-5ecf11abd530" acquired by "delete_volume" :: waited 0.049s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:39 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 Aug 28 20:31:39 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54cd293-fd21-4c27-b3a8-d3d229c05bd1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:39 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:39 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:39 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530 Aug 28 20:31:39 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:39 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4" returned: 0 in 0.413s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:39 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 is being set with open permissions: ugo+rw Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:39 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 Aug 28 20:31:39 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:39 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.424s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:39 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Deleted volume successfully. Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-6b62074d-feb7-4270-b33d-733ecccbdde0 tempest-CinderUnicodeTest-920846619 None] Lock "cinder-b43d5314-5b11-4733-892d-a7ff55df7474-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:39 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530" returned: 0 in 0.535s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:39 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530 Aug 28 20:31:39 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:39 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4" returned: 0 in 0.361s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:39 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.info Aug 28 20:31:39 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:39 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-e45934e1-ea29-43c1-b7aa-5ecf11abd530" returned: 0 in 0.293s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:39 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Lock "cinder-quobyte-e45934e1-ea29-43c1-b7aa-5ecf11abd530" released by "delete_volume" :: held 0.903s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Created reservations ['033fcc3c-b8bf-497b-bb2c-6c2d8a25695f', 'ae731497-c574-4ddd-ab89-5586ef374771', '89620a9f-32e8-4e03-aba2-b4e3c0b20086', '420885ee-3f83-4ae3-b6d0-db456ed3897d'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:40 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:40 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.info" returned: 0 in 0.337s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:40 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.info is being set with open permissions: ugo+rw Aug 28 20:31:40 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:40 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.info Aug 28 20:31:40 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:40 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.info" returned: 0 in 0.309s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:40 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.394s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Deleted volume successfully. Aug 28 20:31:40 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-23d75199-7324-4922-ae36-ae7169eb0827 tempest-ProjectMemberTests-1460928951 None] Create snapshot completed successfully Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b99fbdc2-a41e-4530-8a78-251ff844ca4c tempest-ProjectReaderTests-1347120019 None] Lock "cinder-e45934e1-ea29-43c1-b7aa-5ecf11abd530-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-6c8fc448-20ae-4576-817a-a1e68591bab4-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Lock "cinder-6c8fc448-20ae-4576-817a-a1e68591bab4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-6c8fc448-20ae-4576-817a-a1e68591bab4" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-6c8fc448-20ae-4576-817a-a1e68591bab4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Deleting offline snapshot 6c8fc448-20ae-4576-817a-a1e68591bab4 of volume 74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] snapshot_file for this snap is: volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a225791-ef7b-4bc1-aea4-2edb58ec3099]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:41 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 Aug 28 20:31:41 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:41 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4" returned: 0 in 0.465s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:31:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be134e-293b-471d-bfe8-9b86b45b299c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:41 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 Aug 28 20:31:41 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:41 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" returned: 0 in 0.481s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:42 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 Aug 28 20:31:42 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:42 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4" returned: 0 in 0.407s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:42 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4 Aug 28 20:31:42 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:42 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7.6c8fc448-20ae-4576-817a-a1e68591bab4" returned: 0 in 0.303s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-6c8fc448-20ae-4576-817a-a1e68591bab4" released by "_delete_snapshot" :: held 1.802s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" released by "delete_snapshot" :: held 1.836s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:42 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Created reservations ['cfd6823a-1528-4742-9778-2d8073a0d009', 'f1521f99-e808-4741-86bf-9449d4d0dff8', '47c0727b-db11-4a22-94a0-8bb81c94ac03', 'e58f2d6c-40a0-46e6-8f48-17b3d9cf1dbf'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:42 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Delete snapshot completed successfully. Aug 28 20:31:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1e619e83-9b60-4dbd-b263-0a73acee5caf tempest-ProjectMemberTests-1460928951 None] Lock "cinder-6c8fc448-20ae-4576-817a-a1e68591bab4-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:43 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3dd9e9-66e0-40d9-90d6-b5739e4f3f92]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:43 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 Aug 28 20:31:43 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:43 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" returned: 0 in 0.526s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:43 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7 Aug 28 20:31:43 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-431e1745-0ede-4f9f-83d8-300a4bc7662d tempest-ProjectAdminTests-676695449 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.56498336792, 'free_capacity_gb': 1774.56498336792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86028) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 28 20:31:44 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" returned: 0 in 0.352s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7" released by "delete_volume" :: held 0.987s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Created reservations ['1103c601-074b-4cab-8078-e8707931cc6b', '4897196e-babd-4a4a-aabc-3a06ff4ed888', '16964899-979f-4e83-a4c0-45c0c86c4b32', 'fd063e21-6d0e-4f96-9945-cda0a1409f50'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:44 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:44 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:44 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.267s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:44 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Deleted volume successfully. Aug 28 20:31:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1d89f0aa-26e8-472c-b24f-d44c9fd78449 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-74c2eeb8-26da-41a7-9cfd-584ea3f2b7f7-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (60daa08b-b18f-460d-95dc-88eb33ca3f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc377a6-6eb7-42b8-b429-2571a5946b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc377a6-6eb7-42b8-b429-2571a5946b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1514907509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4ac4a7-c3fb-4afd-a378-0875d89fb91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:46Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633982ed-536a-41ac-8330-53e40c9e58b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633982ed-536a-41ac-8330-53e40c9e58b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f68d54-8e85-454a-9b71-c9c612356b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f68d54-8e85-454a-9b71-c9c612356b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4ac4a7-c3fb-4afd-a378-0875d89fb91e', 'volume_name': 'volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68358af-0ace-4c9c-952b-698846d468e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68358af-0ace-4c9c-952b-698846d468e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b6c73e-c5af-4e0f-8b76-45fbfe0b138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:46 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Volume fc4ac4a7-c3fb-4afd-a378-0875d89fb91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e', 'volume_size': 1} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1514907509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4ac4a7-c3fb-4afd-a378-0875d89fb91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:46Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Creating volume fc4ac4a7-c3fb-4afd-a378-0875d89fb91e {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:46 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:46 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e 1073741824 Aug 28 20:31:46 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:46 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e 1073741824" returned: 0 in 0.587s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:46 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e Aug 28 20:31:46 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:47 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" returned: 0 in 0.317s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:47 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b6c73e-c5af-4e0f-8b76-45fbfe0b138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7795a6e9-e836-48c1-a765-45cc738bffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:47 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Volume volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e (fc4ac4a7-c3fb-4afd-a378-0875d89fb91e): created successfully Aug 28 20:31:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7795a6e9-e836-48c1-a765-45cc738bffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:47 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (60daa08b-b18f-460d-95dc-88eb33ca3f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:47 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c362f7b4-6aea-48dc-a407-a723ba5dc6ad tempest-ProjectMemberTests-1460928951 None] Created volume successfully. Aug 28 20:31:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Creating offline snapshot 2246acab-92fc-4f62-9920-cc6e02c88837 of volume fc4ac4a7-c3fb-4afd-a378-0875d89fb91e {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:31:48 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[95db9cc7-d73a-454e-b814-a302fe32847e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:48 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e Aug 28 20:31:48 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:48 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" returned: 0 in 0.468s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:48 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 1G Aug 28 20:31:48 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:49 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 1G" returned: 0 in 0.584s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:49 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 Aug 28 20:31:49 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:49 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837" returned: 0 in 0.356s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:49 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 is being set with open permissions: ugo+rw Aug 28 20:31:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:49 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 Aug 28 20:31:49 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:50 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837" returned: 0 in 0.304s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:50 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.info Aug 28 20:31:50 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:50 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.info" returned: 0 in 0.283s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:50 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.info is being set with open permissions: ugo+rw Aug 28 20:31:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:50 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.info Aug 28 20:31:50 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:50 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.info" returned: 0 in 0.276s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:50 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-dc2ecd40-1405-4f6b-847c-90b0e4602f2e tempest-ProjectMemberTests-1460928951 None] Create snapshot completed successfully Aug 28 20:31:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-2246acab-92fc-4f62-9920-cc6e02c88837-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-2246acab-92fc-4f62-9920-cc6e02c88837-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-2246acab-92fc-4f62-9920-cc6e02c88837" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-2246acab-92fc-4f62-9920-cc6e02c88837" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Deleting offline snapshot 2246acab-92fc-4f62-9920-cc6e02c88837 of volume fc4ac4a7-c3fb-4afd-a378-0875d89fb91e {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:31:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] snapshot_file for this snap is: volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:31:51 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecb5479-4faa-4132-98af-ed374efd9c34]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:51 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 Aug 28 20:31:51 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:52 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837" returned: 0 in 0.438s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:31:52 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[55064e94-5f48-4b06-aa50-0c69ddb80d6c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:52 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e Aug 28 20:31:52 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:52 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" returned: 0 in 0.418s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:52 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 Aug 28 20:31:52 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:52 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837" returned: 0 in 0.335s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:52 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837 Aug 28 20:31:52 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:53 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e.2246acab-92fc-4f62-9920-cc6e02c88837" returned: 0 in 0.244s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-2246acab-92fc-4f62-9920-cc6e02c88837" released by "_delete_snapshot" :: held 1.550s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" released by "delete_snapshot" :: held 1.573s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Created reservations ['c0abdd50-f258-41f3-8d3d-253f7626f8c3', 'c92aa2fc-13e1-4c2c-ac1e-3d66da21166b', '9d2ab1ce-ddfe-413f-8ffd-c06870f125cd', '0017f540-1f07-4e74-b0a1-4f25847ecafa'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:53 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Delete snapshot completed successfully. Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-f7eb57e6-96fe-49f7-b3aa-909e262436d6 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-2246acab-92fc-4f62-9920-cc6e02c88837-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74903e8-3d92-49e9-9cc8-0fe9bf7dd75b]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:53 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e Aug 28 20:31:53 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:54 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" returned: 0 in 0.397s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:54 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e Aug 28 20:31:54 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:54 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e" released by "delete_volume" :: held 0.750s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Created reservations ['7859b65c-ced1-40da-9059-eaf3b43eb6e2', '95e759f4-e34b-4c2a-8759-49ff04c32df8', '95d8bfaa-624a-4fd0-a552-e41ade787a94', '7ad45432-48be-493c-8a02-457882ffbbe2'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:54 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:31:54 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:54 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.293s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:54 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:31:54 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Deleted volume successfully. Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-b309e458-5075-4b69-995f-0764fea9e566 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-fc4ac4a7-c3fb-4afd-a378-0875d89fb91e-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (8671fc74-d249-4b9c-b0bc-2ceb5b6a40cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cdcfc49-a5ec-4cbe-8ed6-8776d2b7dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cdcfc49-a5ec-4cbe-8ed6-8776d2b7dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158775328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:55Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e86b952-45bc-4972-9030-7e7799cf3569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e86b952-45bc-4972-9030-7e7799cf3569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b1c78d-9405-4333-9fd2-92b4124a92ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b1c78d-9405-4333-9fd2-92b4124a92ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443', 'volume_name': 'volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751332f3-8bdd-4bd0-b257-2fa53b4fade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751332f3-8bdd-4bd0-b257-2fa53b4fade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ffe576-15cf-457b-9271-d4bfe4c28927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:55 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Volume c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443', 'volume_size': 1} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158775328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:31:55Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Creating volume c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:31:55 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:31:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:55 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 1073741824 Aug 28 20:31:55 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:56 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 1073741824" returned: 0 in 0.520s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:56 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 Aug 28 20:31:56 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:56 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" returned: 0 in 0.298s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:56 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:31:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ffe576-15cf-457b-9271-d4bfe4c28927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdf4efb-22f4-415e-85e5-aee749ff5db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:31:56 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Volume volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 (c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443): created successfully Aug 28 20:31:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdf4efb-22f4-415e-85e5-aee749ff5db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:31:56 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (8671fc74-d249-4b9c-b0bc-2ceb5b6a40cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:31:56 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ae26ef4c-9a35-4d66-a831-f5757ae963e7 tempest-ProjectMemberTests-1460928951 None] Created volume successfully. Aug 28 20:31:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:31:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:31:57 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Creating offline snapshot 39914242-4965-4d80-b5ae-5b28c3879114 of volume c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:31:57 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4746cb-e659-4f10-844e-3185b300181c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:31:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:58 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 Aug 28 20:31:58 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:58 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" returned: 0 in 0.384s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:58 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 1G Aug 28 20:31:58 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:58 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 1G" returned: 0 in 0.429s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:58 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 Aug 28 20:31:58 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:59 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114" returned: 0 in 0.315s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:59 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 is being set with open permissions: ugo+rw Aug 28 20:31:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:59 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 Aug 28 20:31:59 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:59 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114" returned: 0 in 0.256s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:59 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.info Aug 28 20:31:59 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:59 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.info" returned: 0 in 0.269s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:59 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.info is being set with open permissions: ugo+rw Aug 28 20:31:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:31:59 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.info Aug 28 20:31:59 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:31:59 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Aug 28 20:31:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.info" returned: 0 in 0.275s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:31:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:31:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-61ef50db-665e-4c4d-91ec-da44cb98d344 tempest-ProjectMemberTests-1460928951 None] Create snapshot completed successfully Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-39914242-4965-4d80-b5ae-5b28c3879114-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Lock "cinder-39914242-4965-4d80-b5ae-5b28c3879114-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-39914242-4965-4d80-b5ae-5b28c3879114" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-39914242-4965-4d80-b5ae-5b28c3879114" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Deleting offline snapshot 39914242-4965-4d80-b5ae-5b28c3879114 of volume c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] snapshot_file for this snap is: volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f583a353-e1e3-47ca-aaf0-a5a5907e390a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:01 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 Aug 28 20:32:01 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:01 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114" returned: 0 in 0.388s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[09745401-f098-49ba-a798-22adc0c71b25]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:01 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 Aug 28 20:32:01 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:01 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" returned: 0 in 0.419s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:01 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 Aug 28 20:32:01 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:02 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114" returned: 0 in 0.336s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:02 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114 Aug 28 20:32:02 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:02 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443.39914242-4965-4d80-b5ae-5b28c3879114" returned: 0 in 0.244s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-39914242-4965-4d80-b5ae-5b28c3879114" released by "_delete_snapshot" :: held 1.478s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" released by "delete_snapshot" :: held 1.503s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:02 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Created reservations ['cfaf4ac0-5d03-4ab4-9cf4-553d3f3a10ed', '1ef527c8-bca8-4901-8fd7-b1181c95c9a8', '03c5f267-70d7-40a4-b89e-3a2dda099fb5', '60db0131-5472-41f5-9ec2-a0f9bae5bc48'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Delete snapshot completed successfully. Aug 28 20:32:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c255a64d-5f94-4d9e-939a-bfc2baaf31da tempest-ProjectMemberTests-1460928951 None] Lock "cinder-39914242-4965-4d80-b5ae-5b28c3879114-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:03 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf7b6e4-7d40-4dfc-8e03-42659be1f0d6]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:03 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 Aug 28 20:32:03 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:03 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" returned: 0 in 0.389s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:03 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443 Aug 28 20:32:03 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:03 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" returned: 0 in 0.287s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443" released by "delete_volume" :: held 0.739s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Created reservations ['78fa96f5-88f3-4dd4-af52-f47b6727d385', '21232ba9-fe76-4955-9323-04bc1319740a', 'bb608049-dc03-4b1d-833d-8a9ca6ccea4b', '2026719c-d249-43ed-8b42-75fc178755ed'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:04 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:32:04 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:04 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.301s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:32:04 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Deleted volume successfully. Aug 28 20:32:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5a598690-0794-4562-8cf9-e49e93398ba3 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-c2e5eab4-9d2c-4d76-9dfe-a1ec905ac443-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (86ae2554-893f-4886-92d3-a26022feb766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be06d07f-f161-439c-9017-d250a52ad8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be06d07f-f161-439c-9017-d250a52ad8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200325503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5259053e-ec54-4899-bdd8-c6037ac65f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:05Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697d75ae-3450-4c5a-965c-a7b638840b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697d75ae-3450-4c5a-965c-a7b638840b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cd9f1d-a793-43c6-95cb-93650f9fc3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cd9f1d-a793-43c6-95cb-93650f9fc3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5259053e-ec54-4899-bdd8-c6037ac65f05', 'volume_name': 'volume-5259053e-ec54-4899-bdd8-c6037ac65f05', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e56d48-e616-4276-b2c4-828b5bf90147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e56d48-e616-4276-b2c4-828b5bf90147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69689e0e-3fa7-4e6e-92df-161193c07a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:05 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Volume 5259053e-ec54-4899-bdd8-c6037ac65f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5259053e-ec54-4899-bdd8-c6037ac65f05', 'volume_size': 1} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200325503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5259053e-ec54-4899-bdd8-c6037ac65f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:05Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Creating volume 5259053e-ec54-4899-bdd8-c6037ac65f05 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:32:05 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:05 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 1073741824 Aug 28 20:32:05 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:05 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 1073741824" returned: 0 in 0.478s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:05 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 Aug 28 20:32:05 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:05 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05" returned: 0 in 0.267s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69689e0e-3fa7-4e6e-92df-161193c07a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5259053e-ec54-4899-bdd8-c6037ac65f05', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ae62ba-d2b9-4a54-9120-17ed3a357a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:05 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Volume volume-5259053e-ec54-4899-bdd8-c6037ac65f05 (5259053e-ec54-4899-bdd8-c6037ac65f05): created successfully Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ae62ba-d2b9-4a54-9120-17ed3a357a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:05 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (86ae2554-893f-4886-92d3-a26022feb766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:05 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1f36aee7-70e4-4d91-975d-66e6c06cda69 tempest-ProjectMemberTests-1460928951 None] Created volume successfully. Aug 28 20:32:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:32:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:06 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:32:06 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:07 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.260s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Creating offline snapshot 0b1afb9a-2349-4d44-978f-118b0ed4d576 of volume 5259053e-ec54-4899-bdd8-c6037ac65f05 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f1f769-58b4-4993-a36c-7c724957d762]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Flow 'volume_create_manager' (75a47493-fc7f-4f04-9ddc-b7505b70fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7c03e8-674b-4795-9261-b1b4fa903dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7c03e8-674b-4795-9261-b1b4fa903dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1267039295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd902b3-bc84-4b23-b636-c198e2ba4032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e43663762f4139a087021102e83e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:07Z,use_quota=True,user_id='f63226522a5e445091724b12b33f4f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a113e4-02b0-4386-adb4-00843c231df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a113e4-02b0-4386-adb4-00843c231df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f22fcd0-92a1-4b11-8eb5-9bded1d07f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f22fcd0-92a1-4b11-8eb5-9bded1d07f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd902b3-bc84-4b23-b636-c198e2ba4032', 'volume_name': 'volume-6bd902b3-bc84-4b23-b636-c198e2ba4032', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82408a2-2003-4fce-8379-2c9c2e23dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82408a2-2003-4fce-8379-2c9c2e23dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d57fd6-4a7e-4a71-bb5a-0c06247c49ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:07 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Volume 6bd902b3-bc84-4b23-b636-c198e2ba4032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd902b3-bc84-4b23-b636-c198e2ba4032', 'volume_size': 1} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:07 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 Aug 28 20:32:07 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:07 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05" returned: 0 in 0.345s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:07 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 1G Aug 28 20:32:07 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:08 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 1G" returned: 0 in 0.392s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5259053e-ec54-4899-bdd8-c6037ac65f05 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:08 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5259053e-ec54-4899-bdd8-c6037ac65f05 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 Aug 28 20:32:08 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:08 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5259053e-ec54-4899-bdd8-c6037ac65f05 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576" returned: 0 in 0.290s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:08 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 is being set with open permissions: ugo+rw Aug 28 20:32:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:08 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 Aug 28 20:32:08 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:08 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576" returned: 0 in 0.241s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:08 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.info Aug 28 20:32:08 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:09 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.info" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:09 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.info is being set with open permissions: ugo+rw Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:09 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.info Aug 28 20:32:09 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:09 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.info" returned: 0 in 0.251s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.711s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1267039295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd902b3-bc84-4b23-b636-c198e2ba4032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e43663762f4139a087021102e83e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:07Z,use_quota=True,user_id='f63226522a5e445091724b12b33f4f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Creating volume 6bd902b3-bc84-4b23-b636-c198e2ba4032 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:32:09 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:09 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 1073741824 Aug 28 20:32:09 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:09 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-955cead2-7dfa-488d-9d93-357df2125ba6 tempest-ProjectMemberTests-1460928951 None] Create snapshot completed successfully Aug 28 20:32:09 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 1073741824" returned: 0 in 0.390s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:09 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 Aug 28 20:32:09 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:09 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d57fd6-4a7e-4a71-bb5a-0c06247c49ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd902b3-bc84-4b23-b636-c198e2ba4032', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aca5715-f7f1-47ee-b0a5-f579abe2323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:10 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Volume volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 (6bd902b3-bc84-4b23-b636-c198e2ba4032): created successfully Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aca5715-f7f1-47ee-b0a5-f579abe2323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Flow 'volume_create_manager' (75a47493-fc7f-4f04-9ddc-b7505b70fd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:10 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-90b611a0-35a4-470a-a25d-70fba021305f tempest-SnapshotDependencyTests-243428877 None] Created volume successfully. Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-0b1afb9a-2349-4d44-978f-118b0ed4d576-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-0b1afb9a-2349-4d44-978f-118b0ed4d576-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-5259053e-ec54-4899-bdd8-c6037ac65f05" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-5259053e-ec54-4899-bdd8-c6037ac65f05" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-0b1afb9a-2349-4d44-978f-118b0ed4d576" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0b1afb9a-2349-4d44-978f-118b0ed4d576" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Deleting offline snapshot 0b1afb9a-2349-4d44-978f-118b0ed4d576 of volume 5259053e-ec54-4899-bdd8-c6037ac65f05 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] snapshot_file for this snap is: volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7400bde-bd0b-49bb-82ff-e36b6500dc70]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:10 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 Aug 28 20:32:10 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Creating offline snapshot 683317b8-1774-4ef7-a647-5a4678d97e89 of volume 6bd902b3-bc84-4b23-b636-c198e2ba4032 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ed3ba9-ef35-4d68-befc-52d38a1af2aa]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:10 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 Aug 28 20:32:10 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:10 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576" returned: 0 in 0.402s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5259053e-ec54-4899-bdd8-c6037ac65f05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd3d28a-15ed-45d6-ae2e-be236ff1bd08]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:11 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 Aug 28 20:32:11 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:11 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032" returned: 0 in 0.373s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:11 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 1G Aug 28 20:32:11 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:11 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05" returned: 0 in 0.364s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:11 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 Aug 28 20:32:11 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:11 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 1G" returned: 0 in 0.410s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:11 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 Aug 28 20:32:11 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:11 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576" returned: 0 in 0.379s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:11 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576 Aug 28 20:32:11 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:11 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89" returned: 0 in 0.306s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:11 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 is being set with open permissions: ugo+rw Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:11 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 Aug 28 20:32:11 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:11 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05.0b1afb9a-2349-4d44-978f-118b0ed4d576" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0b1afb9a-2349-4d44-978f-118b0ed4d576" released by "_delete_snapshot" :: held 1.482s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-5259053e-ec54-4899-bdd8-c6037ac65f05" released by "delete_snapshot" :: held 1.508s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Created reservations ['528de737-6ef4-4173-8f19-96b09e426576', '1a12ce94-9547-4547-ae69-377f38185136', '0481c296-680d-4f14-942f-64e92afef615', '65af5c8c-4f7b-41ca-aa22-bd0fd841b263'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:12 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Delete snapshot completed successfully. Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-38a56ce6-0f16-4de0-bcd0-62b7b4cfe2f2 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-0b1afb9a-2349-4d44-978f-118b0ed4d576-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:12 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:12 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.info Aug 28 20:32:12 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:12 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.info" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:12 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.info is being set with open permissions: ugo+rw Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:12 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.info Aug 28 20:32:12 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-5259053e-ec54-4899-bdd8-c6037ac65f05-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-5259053e-ec54-4899-bdd8-c6037ac65f05-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:12 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-5259053e-ec54-4899-bdd8-c6037ac65f05" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.info" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-5259053e-ec54-4899-bdd8-c6037ac65f05" acquired by "delete_volume" :: waited 0.031s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4da6862-4ceb-44af-b3a3-a8f18783bdba]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:12 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-80fe1391-07bc-4eaa-a680-ea55929e67a5 tempest-SnapshotDependencyTests-243428877 None] Create snapshot completed successfully Aug 28 20:32:12 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 Aug 28 20:32:12 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:13 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05" returned: 0 in 0.361s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:13 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05 Aug 28 20:32:13 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:13 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5259053e-ec54-4899-bdd8-c6037ac65f05" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-5259053e-ec54-4899-bdd8-c6037ac65f05" released by "delete_volume" :: held 0.664s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Created reservations ['03e5691a-aebd-412b-acc4-2315313e40f1', 'a4012295-3ce4-4f29-8622-bffa28a35ccc', '0f0d380e-eeab-4a7c-9f6c-a364ae6e71dc', '55939023-8136-4b37-936f-6037dfd62ef1'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Flow 'volume_create_manager' (5f480de6-905b-4ead-afee-0110f7b3a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:13 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:32:13 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290f7345-f614-4d06-ba9f-834425d02966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290f7345-f614-4d06-ba9f-834425d02966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b719b2d-1279-40b7-b3ba-d28e793ba00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e43663762f4139a087021102e83e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=683317b8-1774-4ef7-a647-5a4678d97e89,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:13Z,use_quota=True,user_id='f63226522a5e445091724b12b33f4f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac53c454-662e-4d05-addd-8dec2c63c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac53c454-662e-4d05-addd-8dec2c63c03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e17d79-77ff-4883-91af-90c95f7bdc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e17d79-77ff-4883-91af-90c95f7bdc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b719b2d-1279-40b7-b3ba-d28e793ba00a', 'volume_name': 'volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a', 'volume_size': 1, 'snapshot_id': '683317b8-1774-4ef7-a647-5a4678d97e89'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91618e36-8812-49fe-b13c-fb0d21d7ec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91618e36-8812-49fe-b13c-fb0d21d7ec79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473cb490-022c-4477-99ce-0f94b94748aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:13 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Volume 9b719b2d-1279-40b7-b3ba-d28e793ba00a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a', 'volume_size': 1, 'snapshot_id': '683317b8-1774-4ef7-a647-5a4678d97e89'} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "cinder-quobyte-683317b8-1774-4ef7-a647-5a4678d97e89-9b719b2d-1279-40b7-b3ba-d28e793ba00a" by "_create_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-683317b8-1774-4ef7-a647-5a4678d97e89-9b719b2d-1279-40b7-b3ba-d28e793ba00a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Creating volume 9b719b2d-1279-40b7-b3ba-d28e793ba00a from snapshot 683317b8-1774-4ef7-a647-5a4678d97e89 {{(pid=86028) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "cinder-quobyte-9b719b2d-1279-40b7-b3ba-d28e793ba00a" by "_copy_volume_from_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-9b719b2d-1279-40b7-b3ba-d28e793ba00a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] snapshot: 683317b8-1774-4ef7-a647-5a4678d97e89, volume: 9b719b2d-1279-40b7-b3ba-d28e793ba00a, {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1970c450-2176-4982-8571-5e164ab0e448]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:13 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.270s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:32:13 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Deleted volume successfully. Aug 28 20:32:13 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 Aug 28 20:32:13 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:13 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-a6ca82c2-0002-498d-beb8-a98bc602e1e6 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-5259053e-ec54-4899-bdd8-c6037ac65f05-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:14 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89" returned: 0 in 0.387s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bd902b3-bc84-4b23-b636-c198e2ba4032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[015e9370-64ea-4319-b9c8-6d22c8f3454e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:32:14 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 Aug 28 20:32:14 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (8bf025ff-6004-4d33-8ebe-5dfdcb5900e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ea0e29-d202-46d2-9d49-88bbf525619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ea0e29-d202-46d2-9d49-88bbf525619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247574132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574e31a9-0194-4d94-8135-745cded04620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:14Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c774c1ec-3313-41e8-80fc-33e028550465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c774c1ec-3313-41e8-80fc-33e028550465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ac143c-7580-4995-9450-c3975987b8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ac143c-7580-4995-9450-c3975987b8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574e31a9-0194-4d94-8135-745cded04620', 'volume_name': 'volume-574e31a9-0194-4d94-8135-745cded04620', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1026447a-eaec-4d6f-a36f-588dafe5fdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1026447a-eaec-4d6f-a36f-588dafe5fdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb08225-8102-48c5-b613-21f798f99603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:14 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Volume 574e31a9-0194-4d94-8135-745cded04620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574e31a9-0194-4d94-8135-745cded04620', 'volume_size': 1} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:14 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032" returned: 0 in 0.356s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Creating direct copy from snapshot {{(pid=86028) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG cinder.utils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Path /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a not found in is_blk_device check {{(pid=86028) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 28 20:32:14 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:14 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a Aug 28 20:32:14 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:18 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a" returned: 0 in 4.143s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.image.image_utils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032, size 1024.00 MB, duration 4.14 sec, destination /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a {{(pid=86028) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 28 20:32:18 devstack cinder-volume[86028]: INFO cinder.image.image_utils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Converted 1024.00 MB image at 247.10 MB/s Aug 28 20:32:18 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a is being set with open permissions: ugo+rw Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:18 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a Aug 28 20:32:18 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:18 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a" returned: 0 in 0.236s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-9b719b2d-1279-40b7-b3ba-d28e793ba00a" released by "_copy_volume_from_snapshot" :: held 5.222s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-683317b8-1774-4ef7-a647-5a4678d97e89-9b719b2d-1279-40b7-b3ba-d28e793ba00a" released by "_create_volume_from_snapshot" :: held 5.278s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.296s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.609s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247574132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574e31a9-0194-4d94-8135-745cded04620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:14Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Creating volume 574e31a9-0194-4d94-8135-745cded04620 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:32:18 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:18 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 1073741824 Aug 28 20:32:18 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473cb490-022c-4477-99ce-0f94b94748aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a', 'volume_size': 1, 'snapshot_id': '683317b8-1774-4ef7-a647-5a4678d97e89'}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e719ef8-36a2-4260-af6f-8e7f9388c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:18 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Volume volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a (9b719b2d-1279-40b7-b3ba-d28e793ba00a): created successfully Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e719ef8-36a2-4260-af6f-8e7f9388c78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Flow 'volume_create_manager' (5f480de6-905b-4ead-afee-0110f7b3a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:18 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-cfffed85-1c0d-4319-b329-d635b1073a3e tempest-SnapshotDependencyTests-243428877 None] Created volume successfully. Aug 28 20:32:19 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 1073741824" returned: 0 in 0.399s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:19 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 Aug 28 20:32:19 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:19 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:32:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb08225-8102-48c5-b613-21f798f99603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574e31a9-0194-4d94-8135-745cded04620', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5dc2b62-cb13-464f-b323-214ee7a44c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:19 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Volume volume-574e31a9-0194-4d94-8135-745cded04620 (574e31a9-0194-4d94-8135-745cded04620): created successfully Aug 28 20:32:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5dc2b62-cb13-464f-b323-214ee7a44c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (8bf025ff-6004-4d33-8ebe-5dfdcb5900e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:19 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0c89f8eb-228b-465c-9e7b-1b1b28e4be7a tempest-ProjectMemberTests-1460928951 None] Created volume successfully. Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "cinder-683317b8-1774-4ef7-a647-5a4678d97e89-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-683317b8-1774-4ef7-a647-5a4678d97e89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "cinder-quobyte-6bd902b3-bc84-4b23-b636-c198e2ba4032" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-6bd902b3-bc84-4b23-b636-c198e2ba4032" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "cinder-quobyte-683317b8-1774-4ef7-a647-5a4678d97e89" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-683317b8-1774-4ef7-a647-5a4678d97e89" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Deleting offline snapshot 683317b8-1774-4ef7-a647-5a4678d97e89 of volume 6bd902b3-bc84-4b23-b636-c198e2ba4032 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] snapshot_file for this snap is: volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d7e94-f883-4c07-b024-8bf28a3455ff]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:20 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 Aug 28 20:32:20 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:20 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89" returned: 0 in 0.358s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bd902b3-bc84-4b23-b636-c198e2ba4032(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabd5fe3-346a-4489-bab7-6e6cf5385253]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:20 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 Aug 28 20:32:20 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Creating offline snapshot 0091b22f-eaf5-4da8-a025-d0fb497a0f2f of volume 574e31a9-0194-4d94-8135-745cded04620 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2a7b8-6ffa-4a38-ace9-486d1773fc55]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:21 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 Aug 28 20:32:21 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:21 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032" returned: 0 in 0.549s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:21 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 Aug 28 20:32:21 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:21 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620" returned: 0 in 0.358s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:21 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f 1G Aug 28 20:32:21 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:21 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89" returned: 0 in 0.356s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:21 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89 Aug 28 20:32:21 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:21 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f 1G" returned: 0 in 0.397s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574e31a9-0194-4d94-8135-745cded04620 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:21 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574e31a9-0194-4d94-8135-745cded04620 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f Aug 28 20:32:21 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:21 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032.683317b8-1774-4ef7-a647-5a4678d97e89" returned: 0 in 0.275s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-683317b8-1774-4ef7-a647-5a4678d97e89" released by "_delete_snapshot" :: held 1.629s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-6bd902b3-bc84-4b23-b636-c198e2ba4032" released by "delete_snapshot" :: held 1.649s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Created reservations ['7ed23f6b-6658-4a69-bcd1-cdc6b794226a', '59fdaa28-42b7-4e07-ab72-ce6743e3504f', '81bb03fa-4b39-42a6-bd15-403ca7988539', '21981a8f-b954-47a2-9964-91d0d53919cc'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Delete snapshot completed successfully. Aug 28 20:32:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5db5ee8f-c538-4845-a10f-3de26dbfd4da tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-683317b8-1774-4ef7-a647-5a4678d97e89-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:21 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574e31a9-0194-4d94-8135-745cded04620 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f" returned: 0 in 0.294s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:22 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f is being set with open permissions: ugo+rw Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:22 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f Aug 28 20:32:22 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:22 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "cinder-6bd902b3-bc84-4b23-b636-c198e2ba4032-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-6bd902b3-bc84-4b23-b636-c198e2ba4032-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:22 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.info Aug 28 20:32:22 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "cinder-quobyte-6bd902b3-bc84-4b23-b636-c198e2ba4032" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-6bd902b3-bc84-4b23-b636-c198e2ba4032" acquired by "delete_volume" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e45530-011a-4a91-9222-96acdb1c181c]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:22 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 Aug 28 20:32:22 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:22 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.info" returned: 0 in 0.259s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:22 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.info is being set with open permissions: ugo+rw Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:22 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.info Aug 28 20:32:22 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:22 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032" returned: 0 in 0.365s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:22 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.info" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:22 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032 Aug 28 20:32:22 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4709764b-849d-4a43-8863-02602981a693 tempest-ProjectMemberTests-1460928951 None] Create snapshot completed successfully Aug 28 20:32:23 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-6bd902b3-bc84-4b23-b636-c198e2ba4032" returned: 0 in 0.252s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-6bd902b3-bc84-4b23-b636-c198e2ba4032" released by "delete_volume" :: held 0.682s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-0091b22f-eaf5-4da8-a025-d0fb497a0f2f-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Lock "cinder-0091b22f-eaf5-4da8-a025-d0fb497a0f2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-574e31a9-0194-4d94-8135-745cded04620" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Created reservations ['3a386e66-e87e-4a8f-a8db-3c8854d6f5dd', '2e9f6453-1245-4bce-970b-d80a6a568493', '507e6b6b-b5c6-42d0-a839-6c39f07c4b1c', 'a16cda8d-4b65-44dd-b259-11df32bba796'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-574e31a9-0194-4d94-8135-745cded04620" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-0091b22f-eaf5-4da8-a025-d0fb497a0f2f" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0091b22f-eaf5-4da8-a025-d0fb497a0f2f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Deleting offline snapshot 0091b22f-eaf5-4da8-a025-d0fb497a0f2f of volume 574e31a9-0194-4d94-8135-745cded04620 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] snapshot_file for this snap is: volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[11121535-37e4-4da5-ac14-ef1e57dc24d8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:23 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:32:23 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:23 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f Aug 28 20:32:23 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "cinder-9b719b2d-1279-40b7-b3ba-d28e793ba00a-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-9b719b2d-1279-40b7-b3ba-d28e793ba00a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:23 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.256s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "cinder-quobyte-9b719b2d-1279-40b7-b3ba-d28e793ba00a" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:23 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Deleted volume successfully. Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-9b719b2d-1279-40b7-b3ba-d28e793ba00a" acquired by "delete_volume" :: waited 0.028s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-02c55643-56df-4773-aee5-3b6e44ef53e6 tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-6bd902b3-bc84-4b23-b636-c198e2ba4032-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bc105c-6608-476f-a8b6-d482f9a2370a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:23 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f" returned: 0 in 0.421s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574e31a9-0194-4d94-8135-745cded04620(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfb74ad-e163-44d3-8bd6-99e48439d53d]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:23 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a Aug 28 20:32:23 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:23 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 Aug 28 20:32:23 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:23 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a" returned: 0 in 0.372s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:23 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a Aug 28 20:32:23 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:23 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620" returned: 0 in 0.371s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:24 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f Aug 28 20:32:24 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:24 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-9b719b2d-1279-40b7-b3ba-d28e793ba00a" returned: 0 in 0.251s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-quobyte-9b719b2d-1279-40b7-b3ba-d28e793ba00a" released by "delete_volume" :: held 0.665s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Created reservations ['4a30f99c-d715-4a9a-b1c7-7b01af5bd660', '03364056-d934-4b5f-a269-ed956672cd18', 'd7c8f4a4-7770-4ad7-a276-2d34626703a7', 'ccc61855-fa58-4c79-88af-334b0dfa68a8'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:24 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:32:24 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:24 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f" returned: 0 in 0.361s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:24 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f Aug 28 20:32:24 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:24 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.253s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:32:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Deleted volume successfully. Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-dd4e5b38-2759-4f4f-a60a-58806cc37ad4 tempest-SnapshotDependencyTests-243428877 None] Lock "cinder-9b719b2d-1279-40b7-b3ba-d28e793ba00a-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:24 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620.0091b22f-eaf5-4da8-a025-d0fb497a0f2f" returned: 0 in 0.277s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-0091b22f-eaf5-4da8-a025-d0fb497a0f2f" released by "_delete_snapshot" :: held 1.528s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-574e31a9-0194-4d94-8135-745cded04620" released by "delete_snapshot" :: held 1.558s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Created reservations ['d2236b3f-58dc-4f7f-b81d-00006e7c7a2f', '3b66bc4f-0441-4089-b831-a3067cfb2c7d', '2e3bfa45-d429-414a-a612-6c5b9d219dd9', '41745dea-4b86-4f87-ac08-ebf81db2485e'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Delete snapshot completed successfully. Aug 28 20:32:24 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-5c83539a-b163-4110-8dbd-b3294958227d tempest-ProjectMemberTests-1460928951 None] Lock "cinder-0091b22f-eaf5-4da8-a025-d0fb497a0f2f-delete_snapshot" released by "delete_snapshot" :: held 1.701s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-574e31a9-0194-4d94-8135-745cded04620-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-574e31a9-0194-4d94-8135-745cded04620-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-574e31a9-0194-4d94-8135-745cded04620" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-574e31a9-0194-4d94-8135-745cded04620" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fefa4f-efec-4371-b899-6649e1e95ba3]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:25 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 Aug 28 20:32:25 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:25 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620" returned: 0 in 0.370s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:25 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620 Aug 28 20:32:25 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:26 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-574e31a9-0194-4d94-8135-745cded04620" returned: 0 in 0.269s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-574e31a9-0194-4d94-8135-745cded04620" released by "delete_volume" :: held 0.724s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Created reservations ['7ebe45ed-60ea-4c8c-8a7f-67428fa96ecd', '4dec6d97-bc2f-4dde-88c6-b6af876a2751', '12f87683-212c-4db3-8957-d2c1fbf1bcc6', '69ae5ebf-a6ac-4fec-85a4-335d72a93b3f'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:26 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:32:26 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:26 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.264s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:32:26 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Deleted volume successfully. Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-c837d23d-6295-446d-9a83-ee3b3ca39925 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-574e31a9-0194-4d94-8135-745cded04620-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (c2d15dd7-0bd5-4230-8100-66cc550a157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f22387a-9191-4fba-9e41-da4ac86f409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f22387a-9191-4fba-9e41-da4ac86f409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1669402472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3c8cd3-199f-46bd-8fcc-7fa761569afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:27Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cfd5e4-943c-4f1e-a8b2-dd7086c04579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cfd5e4-943c-4f1e-a8b2-dd7086c04579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08648282-621b-406d-9e19-cc851589d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08648282-621b-406d-9e19-cc851589d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba3c8cd3-199f-46bd-8fcc-7fa761569afd', 'volume_name': 'volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b44e46b-5825-4674-8bb3-236119c82525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b44e46b-5825-4674-8bb3-236119c82525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13349baa-5c2c-47c9-9817-de1fc8a627e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:26 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Volume ba3c8cd3-199f-46bd-8fcc-7fa761569afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd', 'volume_size': 1} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1669402472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3c8cd3-199f-46bd-8fcc-7fa761569afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e48e54ac54444eb847067ee7b7b54d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:27Z,use_quota=True,user_id='7f94f0aa35aa4afaa4f11ed14f3d8d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Creating volume ba3c8cd3-199f-46bd-8fcc-7fa761569afd {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:32:26 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:32:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:27 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd 1073741824 Aug 28 20:32:27 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:27 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd 1073741824" returned: 0 in 0.405s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:27 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd Aug 28 20:32:27 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:27 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" returned: 0 in 0.238s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:27 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:32:27 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13349baa-5c2c-47c9-9817-de1fc8a627e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0275d8-6571-4fde-8a6e-a7e5e9c17e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:27 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Volume volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd (ba3c8cd3-199f-46bd-8fcc-7fa761569afd): created successfully Aug 28 20:32:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0275d8-6571-4fde-8a6e-a7e5e9c17e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:27 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Flow 'volume_create_manager' (c2d15dd7-0bd5-4230-8100-66cc550a157a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:27 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a9dc4291-d1e4-4ca1-919f-56c72975de45 tempest-ProjectMemberTests-1460928951 None] Created volume successfully. Aug 28 20:32:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:28 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Creating offline snapshot 2c79bebb-cde4-49e3-9694-0a1fb3c6f21d of volume ba3c8cd3-199f-46bd-8fcc-7fa761569afd {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:32:28 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61f34bb-41ba-4e96-9934-d31532ba238a]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:28 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd Aug 28 20:32:28 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:28 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" returned: 0 in 0.370s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:28 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:28 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d 1G Aug 28 20:32:28 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:29 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d 1G" returned: 0 in 0.503s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:29 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d Aug 28 20:32:29 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:29 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d" returned: 0 in 0.295s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:29 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d is being set with open permissions: ugo+rw Aug 28 20:32:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:29 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d Aug 28 20:32:29 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:29 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d" returned: 0 in 0.259s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:29 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.info Aug 28 20:32:29 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:29 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.info" returned: 0 in 0.250s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:29 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.info is being set with open permissions: ugo+rw Aug 28 20:32:29 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:29 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.info Aug 28 20:32:29 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:30 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.info" returned: 0 in 0.238s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:30 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:30 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-4f3fd3eb-10df-4f61-9049-94c67f75aa6e tempest-ProjectMemberTests-1460928951 None] Create snapshot completed successfully Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-2c79bebb-cde4-49e3-9694-0a1fb3c6f21d-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Lock "cinder-2c79bebb-cde4-49e3-9694-0a1fb3c6f21d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-2c79bebb-cde4-49e3-9694-0a1fb3c6f21d" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-2c79bebb-cde4-49e3-9694-0a1fb3c6f21d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Deleting offline snapshot 2c79bebb-cde4-49e3-9694-0a1fb3c6f21d of volume ba3c8cd3-199f-46bd-8fcc-7fa761569afd {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] snapshot_file for this snap is: volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1675a4-ea82-4bd9-aed2-575ab9080040]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:31 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d Aug 28 20:32:31 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:31 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d" returned: 0 in 0.384s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f333fbc-37f1-45ab-9fdf-a7a825c6a15e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:31 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:31 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd Aug 28 20:32:31 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:32 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" returned: 0 in 0.430s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:32 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d Aug 28 20:32:32 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:32 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d" returned: 0 in 0.354s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:32 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d Aug 28 20:32:32 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:32 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:32 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd.2c79bebb-cde4-49e3-9694-0a1fb3c6f21d" returned: 0 in 0.288s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-2c79bebb-cde4-49e3-9694-0a1fb3c6f21d" released by "_delete_snapshot" :: held 1.550s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:32 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" released by "delete_snapshot" :: held 1.573s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:33 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Created reservations ['8ac066e2-ffaf-4548-b6e8-764bec798db8', 'e0373948-59e6-4c5a-b6b7-89d1a5d16817', 'ae6221f1-e40a-4ba9-8827-846226e38acf', '0d569780-ef13-4042-8b8b-9b61ae11a5a5'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:33 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Delete snapshot completed successfully. Aug 28 20:32:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-8b1d2c93-9333-4ffa-b216-a7ac4ac3c24b tempest-ProjectMemberTests-1460928951 None] Lock "cinder-2c79bebb-cde4-49e3-9694-0a1fb3c6f21d-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-ba3c8cd3-199f-46bd-8fcc-7fa761569afd-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-ba3c8cd3-199f-46bd-8fcc-7fa761569afd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "cinder-quobyte-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:33 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:33 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbb9588-b3b8-4992-8b4b-a1c32a323347]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:33 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:33 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd Aug 28 20:32:33 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:34 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" returned: 0 in 0.387s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:34 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd Aug 28 20:32:34 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:34 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" returned: 0 in 0.259s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-quobyte-ba3c8cd3-199f-46bd-8fcc-7fa761569afd" released by "delete_volume" :: held 0.724s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Created reservations ['76954bec-10e9-4e02-bd5a-2629f241e29f', '4c0fc4b2-bff0-498f-bad4-146e7983e9bf', '0252eb75-da5a-4afc-b683-1c71c93a1fb5', '9730d592-a73a-460d-a092-055ccef83128'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:34 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:32:34 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:34 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.261s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:32:34 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Deleted volume successfully. Aug 28 20:32:34 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7b8d77b5-db1f-4391-93a0-409334c64b07 tempest-ProjectMemberTests-1460928951 None] Lock "cinder-ba3c8cd3-199f-46bd-8fcc-7fa761569afd-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=125,cinder:UPDATE=176,cinder:DELETE=12,cinder:INSERT=44 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=138,cinder:INSERT=48,cinder:UPDATE=165,cinder:DELETE=16 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Flow 'volume_create_manager' (af6adcd3-a00e-4490-8df4-b2460eaca4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312816c3-0839-4f67-b778-eace6a2a8f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312816c3-0839-4f67-b778-eace6a2a8f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478896702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29fa2e26-479d-4f9a-86bb-05f846f9efea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d869232e1fe451baf6f7a2f1309bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:38Z,use_quota=True,user_id='b48c093774f04b9d82d367407c006da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad095aa5-841e-441e-9a8e-c7879f361145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad095aa5-841e-441e-9a8e-c7879f361145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25577749-b3de-4565-b27a-dbe386e4cfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25577749-b3de-4565-b27a-dbe386e4cfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29fa2e26-479d-4f9a-86bb-05f846f9efea', 'volume_name': 'volume-29fa2e26-479d-4f9a-86bb-05f846f9efea', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6965e958-652c-41e6-a998-96d075e2cf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6965e958-652c-41e6-a998-96d075e2cf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0650ff13-2a2b-480b-9553-b31c2a7c4bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:38 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Volume 29fa2e26-479d-4f9a-86bb-05f846f9efea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29fa2e26-479d-4f9a-86bb-05f846f9efea', 'volume_size': 1} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478896702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29fa2e26-479d-4f9a-86bb-05f846f9efea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d869232e1fe451baf6f7a2f1309bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:38Z,use_quota=True,user_id='b48c093774f04b9d82d367407c006da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Creating volume 29fa2e26-479d-4f9a-86bb-05f846f9efea {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:32:38 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:38 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea 1073741824 Aug 28 20:32:38 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:38 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea 1073741824" returned: 0 in 0.422s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:38 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea Aug 28 20:32:38 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:38 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea" returned: 0 in 0.236s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0650ff13-2a2b-480b-9553-b31c2a7c4bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29fa2e26-479d-4f9a-86bb-05f846f9efea', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6ec27b-dff2-4b9e-9750-4e261114120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:38 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Volume volume-29fa2e26-479d-4f9a-86bb-05f846f9efea (29fa2e26-479d-4f9a-86bb-05f846f9efea): created successfully Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6ec27b-dff2-4b9e-9750-4e261114120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:38 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Flow 'volume_create_manager' (af6adcd3-a00e-4490-8df4-b2460eaca4f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:38 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-dbeaa79e-a03b-4c31-b6f4-cbede122f707 tempest-ProjectReaderTests-1057789937 None] Created volume successfully. Aug 28 20:32:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:39 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Creating offline snapshot ba404256-8ff7-4784-8751-7260e1a7d4c8 of volume 29fa2e26-479d-4f9a-86bb-05f846f9efea {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:32:39 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d52b6-e5b1-4c7a-8a03-fa1ff23f4c12]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:39 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea Aug 28 20:32:39 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:39 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea" returned: 0 in 0.363s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:39 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 1G Aug 28 20:32:39 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:39 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 1G" returned: 0 in 0.383s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:39 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fa2e26-479d-4f9a-86bb-05f846f9efea -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:40 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fa2e26-479d-4f9a-86bb-05f846f9efea -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 Aug 28 20:32:40 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:40 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29fa2e26-479d-4f9a-86bb-05f846f9efea -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8" returned: 0 in 0.295s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:40 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 is being set with open permissions: ugo+rw Aug 28 20:32:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:40 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 Aug 28 20:32:40 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:40 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8" returned: 0 in 0.250s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:40 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.info Aug 28 20:32:40 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:40 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.info" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:40 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.info is being set with open permissions: ugo+rw Aug 28 20:32:40 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:40 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.info Aug 28 20:32:40 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:41 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.info" returned: 0 in 0.246s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:41 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9b2ea585-131b-4c0d-b21c-f7805d745efe tempest-ProjectReaderTests-1057789937 None] Create snapshot completed successfully Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-ba404256-8ff7-4784-8751-7260e1a7d4c8-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Lock "cinder-ba404256-8ff7-4784-8751-7260e1a7d4c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-29fa2e26-479d-4f9a-86bb-05f846f9efea" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-29fa2e26-479d-4f9a-86bb-05f846f9efea" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-ba404256-8ff7-4784-8751-7260e1a7d4c8" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-ba404256-8ff7-4784-8751-7260e1a7d4c8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Deleting offline snapshot ba404256-8ff7-4784-8751-7260e1a7d4c8 of volume 29fa2e26-479d-4f9a-86bb-05f846f9efea {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] snapshot_file for this snap is: volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad402f38-e4d2-4259-9791-ed41451af30e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:41 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 Aug 28 20:32:41 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:41 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8" returned: 0 in 0.344s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29fa2e26-479d-4f9a-86bb-05f846f9efea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd1f112-3af8-43e2-9911-274a7dd87e60]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:41 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:41 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea Aug 28 20:32:41 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:42 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea" returned: 0 in 0.344s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:42 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 Aug 28 20:32:42 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:42 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8" returned: 0 in 0.319s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:42 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8 Aug 28 20:32:42 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:42 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:42 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea.ba404256-8ff7-4784-8751-7260e1a7d4c8" returned: 0 in 0.240s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-ba404256-8ff7-4784-8751-7260e1a7d4c8" released by "_delete_snapshot" :: held 1.329s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-29fa2e26-479d-4f9a-86bb-05f846f9efea" released by "delete_snapshot" :: held 1.349s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:42 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Created reservations ['7f267c22-16a8-417b-b6ee-b2db2f62ab4d', '6464307d-72bc-4c72-bcc8-28e617120f06', '3cbc5cab-776c-460b-96d3-c1b5f3757158', '74f98e39-6c8b-434a-9e8d-de5f4bfd9111'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:42 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Delete snapshot completed successfully. Aug 28 20:32:42 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-7acb5be2-db23-4f1e-bdc2-391d41b12c7c tempest-ProjectReaderTests-1057789937 None] Lock "cinder-ba404256-8ff7-4784-8751-7260e1a7d4c8-delete_snapshot" released by "delete_snapshot" :: held 1.479s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-29fa2e26-479d-4f9a-86bb-05f846f9efea-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-29fa2e26-479d-4f9a-86bb-05f846f9efea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-29fa2e26-479d-4f9a-86bb-05f846f9efea" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:43 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-29fa2e26-479d-4f9a-86bb-05f846f9efea" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:43 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3280bf-649b-4ad0-a47f-f04d2d7b84e1]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:43 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:43 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea Aug 28 20:32:43 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:44 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea" returned: 0 in 0.350s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:44 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea Aug 28 20:32:44 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:44 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29fa2e26-479d-4f9a-86bb-05f846f9efea" returned: 0 in 0.241s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-29fa2e26-479d-4f9a-86bb-05f846f9efea" released by "delete_volume" :: held 0.643s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Created reservations ['7a92a830-bddb-46f0-8c11-d02fe41ca97c', '154db9ed-2167-407d-8a2a-00fc6b0d9939', '667693b8-6398-4434-bc90-4b0829bf9bfd', '4521843a-7e2d-4860-a190-db7c0aca657f'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:44 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:32:44 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:44 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.238s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:32:44 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Deleted volume successfully. Aug 28 20:32:44 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-9daf3ecf-e099-475a-953a-5adfde0fded4 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-29fa2e26-479d-4f9a-86bb-05f846f9efea-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Flow 'volume_create_manager' (495161f6-f9bd-4469-a69f-3d77007b727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b8fe15-f2da-4a94-b35a-2749754f3b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b8fe15-f2da-4a94-b35a-2749754f3b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222543237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6aef751-9ab3-469e-b011-a08167cf3060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d869232e1fe451baf6f7a2f1309bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:45Z,use_quota=True,user_id='b48c093774f04b9d82d367407c006da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469393d7-cebe-4ca4-9f1d-b51e3ef20710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469393d7-cebe-4ca4-9f1d-b51e3ef20710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f0e851-b26b-4311-aa64-65f02aaf7b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f0e851-b26b-4311-aa64-65f02aaf7b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6aef751-9ab3-469e-b011-a08167cf3060', 'volume_name': 'volume-a6aef751-9ab3-469e-b011-a08167cf3060', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a46c35b-3e26-4fdc-af68-cb6655a8dac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a46c35b-3e26-4fdc-af68-cb6655a8dac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175a47d0-bf51-4d23-803d-c40597fa3bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:45 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Volume a6aef751-9ab3-469e-b011-a08167cf3060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6aef751-9ab3-469e-b011-a08167cf3060', 'volume_size': 1} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222543237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6aef751-9ab3-469e-b011-a08167cf3060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d869232e1fe451baf6f7a2f1309bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:45Z,use_quota=True,user_id='b48c093774f04b9d82d367407c006da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Creating volume a6aef751-9ab3-469e-b011-a08167cf3060 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:32:45 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:45 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 1073741824 Aug 28 20:32:45 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:45 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 1073741824" returned: 0 in 0.393s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:45 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 Aug 28 20:32:45 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:45 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060" returned: 0 in 0.238s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175a47d0-bf51-4d23-803d-c40597fa3bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6aef751-9ab3-469e-b011-a08167cf3060', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58761b1e-c631-4770-8c06-61b5cc3ff4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:45 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Volume volume-a6aef751-9ab3-469e-b011-a08167cf3060 (a6aef751-9ab3-469e-b011-a08167cf3060): created successfully Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58761b1e-c631-4770-8c06-61b5cc3ff4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:45 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Flow 'volume_create_manager' (495161f6-f9bd-4469-a69f-3d77007b727d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:45 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c4268c11-65ac-486c-9203-0aa456ecda8e tempest-ProjectReaderTests-1057789937 None] Created volume successfully. Aug 28 20:32:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:46 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Creating offline snapshot 24e8013e-1534-43da-9e7f-729b19ff056f of volume a6aef751-9ab3-469e-b011-a08167cf3060 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:32:46 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[6566a6f1-3105-43e9-b7fa-f5621a74958f]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:46 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 Aug 28 20:32:46 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:46 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060" returned: 0 in 0.353s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:46 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:46 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f 1G Aug 28 20:32:46 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:47 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f 1G" returned: 0 in 0.373s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6aef751-9ab3-469e-b011-a08167cf3060 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:47 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6aef751-9ab3-469e-b011-a08167cf3060 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f Aug 28 20:32:47 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:47 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6aef751-9ab3-469e-b011-a08167cf3060 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f" returned: 0 in 0.286s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:47 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f is being set with open permissions: ugo+rw Aug 28 20:32:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:47 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f Aug 28 20:32:47 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:47 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f" returned: 0 in 0.233s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:47 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.info Aug 28 20:32:47 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:47 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.info" returned: 0 in 0.238s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:47 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.info is being set with open permissions: ugo+rw Aug 28 20:32:47 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:47 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.info Aug 28 20:32:47 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:48 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.info" returned: 0 in 0.234s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.789s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:48 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9ed7081b-3fe5-4feb-8ac7-8bb07993e7f5 tempest-ProjectReaderTests-1057789937 None] Create snapshot completed successfully Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-24e8013e-1534-43da-9e7f-729b19ff056f-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-24e8013e-1534-43da-9e7f-729b19ff056f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-a6aef751-9ab3-469e-b011-a08167cf3060" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-a6aef751-9ab3-469e-b011-a08167cf3060" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-24e8013e-1534-43da-9e7f-729b19ff056f" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-24e8013e-1534-43da-9e7f-729b19ff056f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Deleting offline snapshot 24e8013e-1534-43da-9e7f-729b19ff056f of volume a6aef751-9ab3-469e-b011-a08167cf3060 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] snapshot_file for this snap is: volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc430229-5e8c-4fe3-9c52-ae6568d0d076]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:48 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f Aug 28 20:32:48 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:48 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f" returned: 0 in 0.349s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6aef751-9ab3-469e-b011-a08167cf3060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[357852bc-0594-49df-b42f-adc9f1b20274]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:48 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:48 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 Aug 28 20:32:48 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:49 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060" returned: 0 in 0.342s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:49 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f Aug 28 20:32:49 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:49 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f" returned: 0 in 0.327s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:49 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f Aug 28 20:32:49 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:49 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:49 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060.24e8013e-1534-43da-9e7f-729b19ff056f" returned: 0 in 0.238s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-24e8013e-1534-43da-9e7f-729b19ff056f" released by "_delete_snapshot" :: held 1.337s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-a6aef751-9ab3-469e-b011-a08167cf3060" released by "delete_snapshot" :: held 1.357s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:49 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Created reservations ['35002fcc-3508-46b2-a045-d6adec26ba27', '8fe766c8-2289-4463-b44a-1492fa1c9093', '4347a07e-fea1-42c0-9298-185c0f8c8133', 'ac437103-a3af-4baf-a7c3-97050e8ebedf'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:49 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Delete snapshot completed successfully. Aug 28 20:32:49 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-da521cf8-a410-4a10-9ef0-c23c8e95ab08 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-24e8013e-1534-43da-9e7f-729b19ff056f-delete_snapshot" released by "delete_snapshot" :: held 1.482s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-a6aef751-9ab3-469e-b011-a08167cf3060-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Lock "cinder-a6aef751-9ab3-469e-b011-a08167cf3060-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-a6aef751-9ab3-469e-b011-a08167cf3060" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:50 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-a6aef751-9ab3-469e-b011-a08167cf3060" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:50 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0740ab-8c4e-420c-b896-5134e6d1b2d4]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:50 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 Aug 28 20:32:50 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:50 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:50 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060" returned: 0 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:51 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060 Aug 28 20:32:51 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:51 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a6aef751-9ab3-469e-b011-a08167cf3060" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-a6aef751-9ab3-469e-b011-a08167cf3060" released by "delete_volume" :: held 0.645s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Created reservations ['4e9b8071-b57e-467b-84a4-c40cf0afe9a2', '93c5bebd-7ab0-4cf4-88ed-a303d6e5c44f', '1aaed76d-f8ce-4b21-b6ba-ba8e31f64010', 'bed76afd-bf33-48c9-8aa6-67de03a0a531'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:51 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:32:51 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:51 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.236s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:32:51 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Deleted volume successfully. Aug 28 20:32:51 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-438d210b-7ccd-498a-b731-de4fe76b6eec tempest-ProjectReaderTests-1057789937 None] Lock "cinder-a6aef751-9ab3-469e-b011-a08167cf3060-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Flow 'volume_create_manager' (69aeb14d-4c0a-4416-a26c-2e1cc0ba6754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8404a55-cfed-407a-b9a6-b891ae128e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8404a55-cfed-407a-b9a6-b891ae128e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701532670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955b3078-ce99-4085-8e20-d27ebdc2c631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d869232e1fe451baf6f7a2f1309bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:52Z,use_quota=True,user_id='b48c093774f04b9d82d367407c006da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb123b22-2a62-4603-bef0-2f24a7e83d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb123b22-2a62-4603-bef0-2f24a7e83d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9688f229-1f01-406d-af4f-7f0909dbbfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9688f229-1f01-406d-af4f-7f0909dbbfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '955b3078-ce99-4085-8e20-d27ebdc2c631', 'volume_name': 'volume-955b3078-ce99-4085-8e20-d27ebdc2c631', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4469db-06ce-43a0-b711-e92875c6a349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4469db-06ce-43a0-b711-e92875c6a349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c75cde-a18e-4368-926b-35f9c6187f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Volume 955b3078-ce99-4085-8e20-d27ebdc2c631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-955b3078-ce99-4085-8e20-d27ebdc2c631', 'volume_size': 1} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701532670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955b3078-ce99-4085-8e20-d27ebdc2c631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d869232e1fe451baf6f7a2f1309bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:52Z,use_quota=True,user_id='b48c093774f04b9d82d367407c006da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Creating volume 955b3078-ce99-4085-8e20-d27ebdc2c631 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:32:52 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:52 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 1073741824 Aug 28 20:32:52 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:52 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 1073741824" returned: 0 in 0.388s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:52 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 Aug 28 20:32:52 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:52 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c75cde-a18e-4368-926b-35f9c6187f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955b3078-ce99-4085-8e20-d27ebdc2c631', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65b2c11-2bf9-41a4-902f-e7224f88f484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:52 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Volume volume-955b3078-ce99-4085-8e20-d27ebdc2c631 (955b3078-ce99-4085-8e20-d27ebdc2c631): created successfully Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65b2c11-2bf9-41a4-902f-e7224f88f484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:52 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Flow 'volume_create_manager' (69aeb14d-4c0a-4416-a26c-2e1cc0ba6754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:52 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-a1dd3fb2-5c0a-49ec-853c-785ae9f27fe0 tempest-ProjectReaderTests-1057789937 None] Created volume successfully. Aug 28 20:32:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:53 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Creating offline snapshot 1129cb65-0417-452b-900c-edc591b823df of volume 955b3078-ce99-4085-8e20-d27ebdc2c631 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:32:53 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60a3999-0c6b-410c-9198-6caa19c58979]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:53 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 Aug 28 20:32:53 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:53 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631" returned: 0 in 0.342s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:53 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:53 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df 1G Aug 28 20:32:53 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:54 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df 1G" returned: 0 in 0.373s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955b3078-ce99-4085-8e20-d27ebdc2c631 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:54 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955b3078-ce99-4085-8e20-d27ebdc2c631 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df Aug 28 20:32:54 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:54 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955b3078-ce99-4085-8e20-d27ebdc2c631 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df" returned: 0 in 0.284s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:54 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df is being set with open permissions: ugo+rw Aug 28 20:32:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:54 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df Aug 28 20:32:54 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:54 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df" returned: 0 in 0.232s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:54 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.info Aug 28 20:32:54 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:54 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.info" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:54 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.info is being set with open permissions: ugo+rw Aug 28 20:32:54 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:54 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.info Aug 28 20:32:54 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:55 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.info" returned: 0 in 0.250s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:55 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-732c24a6-9137-496a-97b5-6d6e2acffafa tempest-ProjectReaderTests-1057789937 None] Create snapshot completed successfully Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-1129cb65-0417-452b-900c-edc591b823df-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Lock "cinder-1129cb65-0417-452b-900c-edc591b823df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-955b3078-ce99-4085-8e20-d27ebdc2c631" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-955b3078-ce99-4085-8e20-d27ebdc2c631" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-1129cb65-0417-452b-900c-edc591b823df" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-1129cb65-0417-452b-900c-edc591b823df" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Deleting offline snapshot 1129cb65-0417-452b-900c-edc591b823df of volume 955b3078-ce99-4085-8e20-d27ebdc2c631 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] snapshot_file for this snap is: volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[b770f1b8-0f8b-45b3-9ac9-92e6ea3802db]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:55 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df Aug 28 20:32:55 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:55 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df" returned: 0 in 0.341s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-955b3078-ce99-4085-8e20-d27ebdc2c631(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[4652626a-b51b-4a62-b93c-abcb56e5b58e]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:55 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:55 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 Aug 28 20:32:55 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:56 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631" returned: 0 in 0.345s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:56 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df Aug 28 20:32:56 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:56 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df" returned: 0 in 0.321s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:56 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df Aug 28 20:32:56 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:56 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:56 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631.1129cb65-0417-452b-900c-edc591b823df" returned: 0 in 0.233s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-1129cb65-0417-452b-900c-edc591b823df" released by "_delete_snapshot" :: held 1.317s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-955b3078-ce99-4085-8e20-d27ebdc2c631" released by "delete_snapshot" :: held 1.337s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:56 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Created reservations ['99119069-17c5-47fa-9cf5-cb57cb92a7c1', '8fdbdc1f-59df-47a9-86f2-b272e167a8f1', '4140e83f-5b39-451b-af1f-2ad621ed7f79', '24b6a0b7-9473-49fd-add4-d6caa1e8c019'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:56 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Delete snapshot completed successfully. Aug 28 20:32:56 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-52fb1103-179d-426b-84be-c71fcb44e79a tempest-ProjectReaderTests-1057789937 None] Lock "cinder-1129cb65-0417-452b-900c-edc591b823df-delete_snapshot" released by "delete_snapshot" :: held 1.461s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-955b3078-ce99-4085-8e20-d27ebdc2c631-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-955b3078-ce99-4085-8e20-d27ebdc2c631-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-955b3078-ce99-4085-8e20-d27ebdc2c631" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:32:57 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-955b3078-ce99-4085-8e20-d27ebdc2c631" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:32:57 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa02037e-94a1-482a-8f35-6acd156ffbdf]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:32:57 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:57 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 Aug 28 20:32:57 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:58 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631" returned: 0 in 0.366s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:58 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631 Aug 28 20:32:58 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:58 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-955b3078-ce99-4085-8e20-d27ebdc2c631" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-955b3078-ce99-4085-8e20-d27ebdc2c631" released by "delete_volume" :: held 0.674s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Created reservations ['5f93749b-2f42-401e-b831-fd2fc73d18b3', '68ebbeab-c34e-4046-a52a-53a25bd70a29', 'e841a0b2-e2c2-48d0-9420-544d7b76c4b0', '1f15c4d2-3946-481a-8e4b-46555176ae03'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:58 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:32:58 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:58 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.245s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:32:58 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Deleted volume successfully. Aug 28 20:32:58 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-fe4daf83-b580-4cd5-b82a-7746c37d6460 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-955b3078-ce99-4085-8e20-d27ebdc2c631-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Flow 'volume_create_manager' (2b3b1f8b-db0f-4a1a-9524-ef8b94a84b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd6810f-eb3b-4a08-a9a8-e93066fc0891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd6810f-eb3b-4a08-a9a8-e93066fc0891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-528632148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a673ac-09e9-441d-962c-710e844bfa34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d869232e1fe451baf6f7a2f1309bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:59Z,use_quota=True,user_id='b48c093774f04b9d82d367407c006da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc1d7b8-8429-46b4-8bd2-5db878a57f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc1d7b8-8429-46b4-8bd2-5db878a57f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592c6d0d-54b7-4e5e-beee-3a340c7502db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592c6d0d-54b7-4e5e-beee-3a340c7502db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a673ac-09e9-441d-962c-710e844bfa34', 'volume_name': 'volume-29a673ac-09e9-441d-962c-710e844bfa34', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5522527d-e0cf-4b28-a5c7-935e05d5f2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5522527d-e0cf-4b28-a5c7-935e05d5f2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a07b9d-ad44-4ae4-b6ea-93d47f2356d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:59 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Volume 29a673ac-09e9-441d-962c-710e844bfa34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a673ac-09e9-441d-962c-710e844bfa34', 'volume_size': 1} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-528632148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a673ac-09e9-441d-962c-710e844bfa34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d869232e1fe451baf6f7a2f1309bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:32:59Z,use_quota=True,user_id='b48c093774f04b9d82d367407c006da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Creating volume 29a673ac-09e9-441d-962c-710e844bfa34 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:32:59 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:59 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 1073741824 Aug 28 20:32:59 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:59 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 1073741824" returned: 0 in 0.391s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:32:59 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 Aug 28 20:32:59 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:32:59 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34" returned: 0 in 0.232s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a07b9d-ad44-4ae4-b6ea-93d47f2356d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a673ac-09e9-441d-962c-710e844bfa34', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea2cfc4-061f-4038-838f-2aa863ef9fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:32:59 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Volume volume-29a673ac-09e9-441d-962c-710e844bfa34 (29a673ac-09e9-441d-962c-710e844bfa34): created successfully Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea2cfc4-061f-4038-838f-2aa863ef9fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:32:59 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Flow 'volume_create_manager' (2b3b1f8b-db0f-4a1a-9524-ef8b94a84b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:32:59 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-ffbe1fd6-9c62-4d0a-88b7-3245d3d45c5a tempest-ProjectReaderTests-1057789937 None] Created volume successfully. Aug 28 20:33:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:00 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Creating offline snapshot ed3d6427-d418-46b9-afcc-1515b1576e8a of volume 29a673ac-09e9-441d-962c-710e844bfa34 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:33:00 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c55a9e-2a54-4ec5-b159-b53be002fab2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:00 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 Aug 28 20:33:00 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:00 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34" returned: 0 in 0.343s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:00 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:00 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a 1G Aug 28 20:33:00 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:01 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a 1G" returned: 0 in 0.375s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a673ac-09e9-441d-962c-710e844bfa34 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:01 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a673ac-09e9-441d-962c-710e844bfa34 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a Aug 28 20:33:01 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:01 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a673ac-09e9-441d-962c-710e844bfa34 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a" returned: 0 in 0.282s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:01 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a is being set with open permissions: ugo+rw Aug 28 20:33:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:01 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a Aug 28 20:33:01 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:01 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a" returned: 0 in 0.232s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:01 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.info Aug 28 20:33:01 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:01 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.info" returned: 0 in 0.247s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:01 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.info is being set with open permissions: ugo+rw Aug 28 20:33:01 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:01 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.info Aug 28 20:33:01 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:02 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.info" returned: 0 in 0.235s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:02 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-f9495cec-8d22-4443-93eb-805749aa46bb tempest-ProjectReaderTests-1057789937 None] Create snapshot completed successfully Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-ed3d6427-d418-46b9-afcc-1515b1576e8a-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-ed3d6427-d418-46b9-afcc-1515b1576e8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-29a673ac-09e9-441d-962c-710e844bfa34" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-29a673ac-09e9-441d-962c-710e844bfa34" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-ed3d6427-d418-46b9-afcc-1515b1576e8a" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-ed3d6427-d418-46b9-afcc-1515b1576e8a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Deleting offline snapshot ed3d6427-d418-46b9-afcc-1515b1576e8a of volume 29a673ac-09e9-441d-962c-710e844bfa34 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] snapshot_file for this snap is: volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[348e4818-b532-4f3c-a78f-9453b43ad501]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:02 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a Aug 28 20:33:02 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:02 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a" returned: 0 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a673ac-09e9-441d-962c-710e844bfa34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee54254e-5902-4c48-ab6a-3c7ed76937f8]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:02 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:02 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 Aug 28 20:33:02 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:03 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34" returned: 0 in 0.346s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:03 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a Aug 28 20:33:03 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:03 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a" returned: 0 in 0.323s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:03 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a Aug 28 20:33:03 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:03 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:03 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34.ed3d6427-d418-46b9-afcc-1515b1576e8a" returned: 0 in 0.230s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-ed3d6427-d418-46b9-afcc-1515b1576e8a" released by "_delete_snapshot" :: held 1.328s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-29a673ac-09e9-441d-962c-710e844bfa34" released by "delete_snapshot" :: held 1.351s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:03 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Created reservations ['cb805a5b-c820-4089-9c92-cb5f2064cda8', '7ebaaa56-1090-4146-a7af-d1f928082b32', '4eaa4422-116a-4fa3-af76-7f2eb0d6cc76', '2e80e801-7386-460d-a5f2-89a69fff5034'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:33:03 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Delete snapshot completed successfully. Aug 28 20:33:03 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1fbac73b-3000-42b0-add6-5d72662288e3 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-ed3d6427-d418-46b9-afcc-1515b1576e8a-delete_snapshot" released by "delete_snapshot" :: held 1.480s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-29a673ac-09e9-441d-962c-710e844bfa34-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-29a673ac-09e9-441d-962c-710e844bfa34-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-29a673ac-09e9-441d-962c-710e844bfa34" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:04 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-29a673ac-09e9-441d-962c-710e844bfa34" acquired by "delete_volume" :: waited 0.016s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:04 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadeec85-4909-4a7e-a22e-255d2e3f34d0]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:04 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 Aug 28 20:33:04 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:04 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34" returned: 0 in 0.348s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:04 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:05 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34 Aug 28 20:33:05 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:05 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-29a673ac-09e9-441d-962c-710e844bfa34" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-29a673ac-09e9-441d-962c-710e844bfa34" released by "delete_volume" :: held 0.642s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Created reservations ['df08d1b6-b536-4716-b098-868bba738de3', 'ac8e3ec1-2782-47f3-abcc-e231f641b46d', '5042975e-a1a4-4fe5-8ae4-59a61d7de921', '4a07e98d-b935-4c48-92ea-015081c40e46'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:05 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:33:05 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:05 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:33:05 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Deleted volume successfully. Aug 28 20:33:05 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d121145-7356-416f-8e41-8f2a4a34c048 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-29a673ac-09e9-441d-962c-710e844bfa34-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Flow 'volume_create_manager' (306436d6-fe3d-45f9-a80a-c31cbeb61300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f66517-29e5-4783-90e6-800a489249ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f66517-29e5-4783-90e6-800a489249ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15882781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9709521-601f-4f89-8635-07d5ebf0de97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d869232e1fe451baf6f7a2f1309bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:33:06Z,use_quota=True,user_id='b48c093774f04b9d82d367407c006da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94782f2a-a81e-4360-89d2-18662cab514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94782f2a-a81e-4360-89d2-18662cab514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533247dc-bb8e-446b-a121-1298deb9c3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533247dc-bb8e-446b-a121-1298deb9c3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9709521-601f-4f89-8635-07d5ebf0de97', 'volume_name': 'volume-d9709521-601f-4f89-8635-07d5ebf0de97', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0eae23e-66fd-467e-b64c-3aad602eea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0eae23e-66fd-467e-b64c-3aad602eea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4f92d2-766a-4adb-b740-7850294f35cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:06 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Volume d9709521-601f-4f89-8635-07d5ebf0de97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9709521-601f-4f89-8635-07d5ebf0de97', 'volume_size': 1} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15882781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9709521-601f-4f89-8635-07d5ebf0de97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d869232e1fe451baf6f7a2f1309bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:33:06Z,use_quota=True,user_id='b48c093774f04b9d82d367407c006da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Creating volume d9709521-601f-4f89-8635-07d5ebf0de97 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:33:06 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:06 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 1073741824 Aug 28 20:33:06 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:06 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 1073741824" returned: 0 in 0.393s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:06 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 Aug 28 20:33:06 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:06 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97" returned: 0 in 0.255s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:06 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4f92d2-766a-4adb-b740-7850294f35cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9709521-601f-4f89-8635-07d5ebf0de97', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:06 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55779ef8-9871-4914-8197-0ca34e88c6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:06 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Volume volume-d9709521-601f-4f89-8635-07d5ebf0de97 (d9709521-601f-4f89-8635-07d5ebf0de97): created successfully Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55779ef8-9871-4914-8197-0ca34e88c6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:06 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Flow 'volume_create_manager' (306436d6-fe3d-45f9-a80a-c31cbeb61300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:33:06 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-241d787f-4730-49a8-bd1b-ca62170fec56 tempest-ProjectReaderTests-1057789937 None] Created volume successfully. Aug 28 20:33:07 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.259s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG oslo_service.periodic_task [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] Running periodic task VolumeManager._thread_info {{(pid=86028) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread count: 28 {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-a481026c-427f-4a61-9003-f2d1d7709ed8 None None] thread info: [<_MainThread(MainThread, started 127703446651008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86028) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Creating offline snapshot 4b7a2eb1-7f7a-403b-a936-188b6c44e004 of volume d9709521-601f-4f89-8635-07d5ebf0de97 {{(pid=86028) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b5d7fd-a134-4f6d-b831-0efffe823eef]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:07 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 Aug 28 20:33:07 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:07 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97" returned: 0 in 0.365s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:07 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 1G {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:07 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 1G Aug 28 20:33:07 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:08 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 1G" returned: 0 in 0.379s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9709521-601f-4f89-8635-07d5ebf0de97 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:08 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9709521-601f-4f89-8635-07d5ebf0de97 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 Aug 28 20:33:08 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:08 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9709521-601f-4f89-8635-07d5ebf0de97 -F qcow2 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004" returned: 0 in 0.283s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:08 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 is being set with open permissions: ugo+rw Aug 28 20:33:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:08 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 Aug 28 20:33:08 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:08 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:08 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.info Aug 28 20:33:08 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:08 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.info" returned: 0 in 0.246s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:08 devstack cinder-volume[86028]: WARNING cinder.volume.drivers.remotefs [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.info is being set with open permissions: ugo+rw Aug 28 20:33:08 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.info {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:08 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.info Aug 28 20:33:08 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:09 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.info" returned: 0 in 0.240s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:09 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-2c809265-c481-4640-91f1-c956e7aedd9a tempest-ProjectReaderTests-1057789937 None] Create snapshot completed successfully Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-4b7a2eb1-7f7a-403b-a936-188b6c44e004-delete_snapshot" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-4b7a2eb1-7f7a-403b-a936-188b6c44e004-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-d9709521-601f-4f89-8635-07d5ebf0de97" by "delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-d9709521-601f-4f89-8635-07d5ebf0de97" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-4b7a2eb1-7f7a-403b-a936-188b6c44e004" by "_delete_snapshot" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-4b7a2eb1-7f7a-403b-a936-188b6c44e004" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Deleting offline snapshot 4b7a2eb1-7f7a-403b-a936-188b6c44e004 of volume d9709521-601f-4f89-8635-07d5ebf0de97 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] snapshot_file for this snap is: volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 {{(pid=86028) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b514e2-6a82-473c-b8bf-5daefb85db79]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:09 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 Aug 28 20:33:09 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:09 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004" returned: 0 in 0.353s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9709521-601f-4f89-8635-07d5ebf0de97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86028) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf4dc44-10a5-4458-90d2-303858127ed9]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:09 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:10 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 Aug 28 20:33:10 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:10 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97" returned: 0 in 0.348s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:10 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 Aug 28 20:33:10 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:10 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004" returned: 0 in 0.316s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:10 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004 Aug 28 20:33:10 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:10 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:10 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97.4b7a2eb1-7f7a-403b-a936-188b6c44e004" returned: 0 in 0.236s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-4b7a2eb1-7f7a-403b-a936-188b6c44e004" released by "_delete_snapshot" :: held 1.336s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-d9709521-601f-4f89-8635-07d5ebf0de97" released by "delete_snapshot" :: held 1.359s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:10 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Created reservations ['8e0ddf6c-e56b-4456-b549-91247c08b3b4', '4b556688-2092-4040-8f9e-f96a8e0c0c5b', 'c2ff38eb-e319-430a-80df-cb2ae14755e4', '25513753-eb1a-4425-a2b4-22fcf64a2d34'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:33:10 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Delete snapshot completed successfully. Aug 28 20:33:10 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-135f6027-01fb-4b1e-b57a-b73af6bf5363 tempest-ProjectReaderTests-1057789937 None] Lock "cinder-4b7a2eb1-7f7a-403b-a936-188b6c44e004-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-d9709521-601f-4f89-8635-07d5ebf0de97-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Lock "cinder-d9709521-601f-4f89-8635-07d5ebf0de97-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Acquiring lock "cinder-quobyte-d9709521-601f-4f89-8635-07d5ebf0de97" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:11 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-d9709521-601f-4f89-8635-07d5ebf0de97" acquired by "delete_volume" :: waited 0.020s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:11 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef265f6-2c49-4131-94b6-a07e509809c2]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:11 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:11 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 Aug 28 20:33:11 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:12 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97" returned: 0 in 0.341s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:12 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97 Aug 28 20:33:12 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:12 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-d9709521-601f-4f89-8635-07d5ebf0de97" returned: 0 in 0.240s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Lock "cinder-quobyte-d9709521-601f-4f89-8635-07d5ebf0de97" released by "delete_volume" :: held 0.636s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Created reservations ['c63a2dc4-fec3-40a0-a6c4-ad57c0fb9015', 'ae2bb8e7-59a7-4eef-9b5b-2acc42276c66', 'bd015c1e-d9d7-458a-9a6e-fb24505fb33c', '2949b1e8-5fee-49c1-9045-2e05571dc1c2'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:12 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:33:12 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:12 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:33:12 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Deleted volume successfully. Aug 28 20:33:12 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-0d7257e5-5465-4c3c-a8c8-943a7325c76a tempest-ProjectReaderTests-1057789937 None] Lock "cinder-d9709521-601f-4f89-8635-07d5ebf0de97-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Flow 'volume_create_manager' (9e447689-c770-4c71-9dc2-e13759ee65ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366f7e9d-2f7d-4473-aa29-86e161705f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366f7e9d-2f7d-4473-aa29-86e161705f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-652972637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327154c7d0874adc95b710a245dbc31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:33:16Z,use_quota=True,user_id='98085000c35d4f6ab06d575efabd15b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4375931-b9ac-47ea-a939-6d57b8ba111e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4375931-b9ac-47ea-a939-6d57b8ba111e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df39ee2a-1a96-4bce-9094-0840af9507d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df39ee2a-1a96-4bce-9094-0840af9507d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d', 'volume_name': 'volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b50a7b-4de8-4dac-863f-b42ed15814f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b50a7b-4de8-4dac-863f-b42ed15814f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beddaf43-26b6-406a-a36b-d92491bb6a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:16 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Volume ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d', 'volume_size': 1} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-652972637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327154c7d0874adc95b710a245dbc31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:33:16Z,use_quota=True,user_id='98085000c35d4f6ab06d575efabd15b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Creating volume ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:33:16 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:16 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d 1073741824 Aug 28 20:33:16 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:16 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d 1073741824" returned: 0 in 0.401s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:16 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d Aug 28 20:33:16 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:16 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beddaf43-26b6-406a-a36b-d92491bb6a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6a2b63-9ce5-475e-98a6-c2d61e8f8b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:16 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Volume volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d (ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d): created successfully Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6a2b63-9ce5-475e-98a6-c2d61e8f8b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:16 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Flow 'volume_create_manager' (9e447689-c770-4c71-9dc2-e13759ee65ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:33:16 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-6622abb1-a505-42ef-af65-4189b2e4a3f8 tempest-ProjectReaderTests-502124558 None] Created volume successfully. Aug 28 20:33:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Acquiring lock "cinder-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Lock "cinder-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Acquiring lock "cinder-quobyte-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:17 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Lock "cinder-quobyte-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d" acquired by "delete_volume" :: waited 0.015s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:17 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6a9ebc-9e36-4321-8614-38943bb72315]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:17 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d Aug 28 20:33:17 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:17 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d" returned: 0 in 0.355s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:17 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:17 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d Aug 28 20:33:17 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:18 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d" returned: 0 in 0.249s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Lock "cinder-quobyte-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d" released by "delete_volume" :: held 0.640s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Created reservations ['cf7bf233-3594-4318-8147-d120c215aff2', '88f8deae-99a4-4f55-8d8c-747689296daf', 'ccdebbd1-bad5-4501-b7a9-15009c1aaade', '3506f83d-00bb-4d38-8b31-6e0593b50421'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:18 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:33:18 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:18 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.241s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:33:18 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Deleted volume successfully. Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-237e0a07-ed41-437f-b286-31ade869b3cc tempest-ProjectReaderTests-502124558 None] Lock "cinder-ca4db520-0fb9-4a56-a94b-4c5ea4b13f5d-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Flow 'volume_create_manager' (fffbaba0-b2a9-480d-945d-c10c3c23922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9141904a-1805-42fa-bcaf-5f0a379fffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9141904a-1805-42fa-bcaf-5f0a379fffd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-530890611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327154c7d0874adc95b710a245dbc31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:33:19Z,use_quota=True,user_id='98085000c35d4f6ab06d575efabd15b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43a2b9e-9e3e-4be2-886e-61f7a3df5e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43a2b9e-9e3e-4be2-886e-61f7a3df5e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6207f988-3185-4015-865d-adea98ec9792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6207f988-3185-4015-865d-adea98ec9792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5', 'volume_name': 'volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb46caca-ac94-4bb4-a14a-ab85cf24771f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb46caca-ac94-4bb4-a14a-ab85cf24771f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0e205c-efaa-469d-adc9-d00e2e809731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:18 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Volume a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5', 'volume_size': 1} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-530890611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327154c7d0874adc95b710a245dbc31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:33:19Z,use_quota=True,user_id='98085000c35d4f6ab06d575efabd15b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Creating volume a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:33:18 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:33:18 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:19 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 1073741824 Aug 28 20:33:19 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:19 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 1073741824" returned: 0 in 0.400s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:19 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 Aug 28 20:33:19 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:19 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0e205c-efaa-469d-adc9-d00e2e809731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32859e37-98fb-42b4-b906-5b6bb413feda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:19 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Volume volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 (a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5): created successfully Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32859e37-98fb-42b4-b906-5b6bb413feda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Flow 'volume_create_manager' (fffbaba0-b2a9-480d-945d-c10c3c23922c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:33:19 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-9d9e9ad3-292c-47db-a2b2-730f33469ea6 tempest-ProjectReaderTests-502124558 None] Created volume successfully. Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Acquiring lock "cinder-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:19 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Lock "cinder-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Acquiring lock "cinder-quobyte-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Lock "cinder-quobyte-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5" acquired by "delete_volume" :: waited 0.013s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a32279d-cfd9-4295-9f70-4bb1f8abf475]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:20 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 Aug 28 20:33:20 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:20 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5" returned: 0 in 0.357s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:20 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5 Aug 28 20:33:20 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:20 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5" returned: 0 in 0.248s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Lock "cinder-quobyte-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5" released by "delete_volume" :: held 0.643s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Created reservations ['2401bc24-0865-4df0-9fb8-17824fbb7289', '2bc3827e-3776-4713-9302-188af7af7fd0', '61537b34-89f0-4b5a-8017-95d5b11ea7fc', '0e932e1d-e9d0-4bc5-9f7f-54669321d5d2'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:20 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:20 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:33:20 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:21 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.242s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:33:21 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Deleted volume successfully. Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-d32d0fb6-23cd-409b-9a8f-473617e53ebd tempest-ProjectReaderTests-502124558 None] Lock "cinder-a2ddeedd-a0ad-44b1-a7b1-e6010dab13c5-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Flow 'volume_create_manager' (c2ecc04f-131d-4c9c-8544-60e214b14784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269abcff-75d1-4ace-bcfa-dd7baa6d637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269abcff-75d1-4ace-bcfa-dd7baa6d637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-946377503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327154c7d0874adc95b710a245dbc31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:33:21Z,use_quota=True,user_id='98085000c35d4f6ab06d575efabd15b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431bfd3b-065c-4a24-b801-3fbaf3214a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431bfd3b-065c-4a24-b801-3fbaf3214a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0773d0-ae77-4c90-bf3e-68b6272f6e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0773d0-ae77-4c90-bf3e-68b6272f6e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375', 'volume_name': 'volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11c110b-a825-4fb6-a26a-396cc83c6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11c110b-a825-4fb6-a26a-396cc83c6832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8767e671-0189-463c-971d-2b2a1cba3057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:21 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Volume 5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375', 'volume_size': 1} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-946377503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327154c7d0874adc95b710a245dbc31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:33:21Z,use_quota=True,user_id='98085000c35d4f6ab06d575efabd15b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Creating volume 5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:33:21 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:33:21 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:21 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 1073741824 Aug 28 20:33:21 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:22 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 1073741824" returned: 0 in 0.397s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:22 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 Aug 28 20:33:22 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:22 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375" returned: 0 in 0.239s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8767e671-0189-463c-971d-2b2a1cba3057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1e9e1a-e3a9-4666-adff-046969ec2cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:22 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Volume volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 (5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375): created successfully Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1e9e1a-e3a9-4666-adff-046969ec2cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Flow 'volume_create_manager' (c2ecc04f-131d-4c9c-8544-60e214b14784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:33:22 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-c0d9f464-dcbb-4b78-96b5-e9c2eafd20c8 tempest-ProjectReaderTests-502124558 None] Created volume successfully. Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Acquiring lock "cinder-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Lock "cinder-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Acquiring lock "cinder-quobyte-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Lock "cinder-quobyte-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375" acquired by "delete_volume" :: waited 0.014s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28bb736-787f-4ef9-aad5-ffdff99026af]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:22 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:22 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 Aug 28 20:33:22 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:23 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375" returned: 0 in 0.344s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:23 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375 Aug 28 20:33:23 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:23 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375" returned: 0 in 0.235s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Lock "cinder-quobyte-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375" released by "delete_volume" :: held 0.615s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Created reservations ['bd18528d-3d6b-4bb3-9228-99df6aa1c8e4', '0ead368d-5123-4787-a0dd-ed86a915d206', '1d0ec719-8d8f-40da-b440-12772dbbaec3', '689b51d8-ce65-497c-8b00-c8e349792def'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:23 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:33:23 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:23 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:33:23 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Deleted volume successfully. Aug 28 20:33:23 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-3153fd79-1d58-41e5-a71f-e91699f7e72f tempest-ProjectReaderTests-502124558 None] Lock "cinder-5f7bbe34-67e6-4ae4-ad47-6f19fb2b2375-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.flows.manager.create_volume [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86028) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Flow 'volume_create_manager' (1436c0f3-5fb5-4d32-8fc4-0d675724cbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60c70a4-0285-499f-87b5-f1fd92630392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60c70a4-0285-499f-87b5-f1fd92630392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567277942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f58247-8525-40ef-b9c9-e0d3adad0fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327154c7d0874adc95b710a245dbc31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:33:24Z,use_quota=True,user_id='98085000c35d4f6ab06d575efabd15b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6105e8-ec49-4ac7-8601-28d325f4729d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6105e8-ec49-4ac7-8601-28d325f4729d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb7a926-b24d-4029-9a24-aa41b6d0a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb7a926-b24d-4029-9a24-aa41b6d0a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f58247-8525-40ef-b9c9-e0d3adad0fab', 'volume_name': 'volume-03f58247-8525-40ef-b9c9-e0d3adad0fab', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79887cb-f5b1-466b-97ca-ae0397742fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79887cb-f5b1-466b-97ca-ae0397742fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd09fa95-6bea-4be8-a18f-3d4d2e890530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:24 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Volume 03f58247-8525-40ef-b9c9-e0d3adad0fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f58247-8525-40ef-b9c9-e0d3adad0fab', 'volume_size': 1} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T18:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567277942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f58247-8525-40ef-b9c9-e0d3adad0fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327154c7d0874adc95b710a245dbc31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T18:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T18:33:24Z,use_quota=True,user_id='98085000c35d4f6ab06d575efabd15b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3301f72e-9d79-49ac-be79-5f106442287d),volume_type_id=3301f72e-9d79-49ac-be79-5f106442287d)}" {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.remotefs [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Creating volume 03f58247-8525-40ef-b9c9-e0d3adad0fab {{(pid=86028) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Selected osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 as target Quobyte volume. {{(pid=86028) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 28 20:33:24 devstack cinder-volume[86028]: INFO cinder.volume.drivers.remotefs [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] casted to osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838 Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab 1073741824 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:24 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab 1073741824 Aug 28 20:33:24 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:24 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab 1073741824" returned: 0 in 0.396s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:24 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab Aug 28 20:33:24 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:24 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab" returned: 0 in 0.236s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'} {{(pid=86028) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd09fa95-6bea-4be8-a18f-3d4d2e890530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f58247-8525-40ef-b9c9-e0d3adad0fab', 'volume_size': 1}' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7726c01-2fd8-46fd-b33e-edf8f73c63ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 28 20:33:24 devstack cinder-volume[86028]: INFO cinder.volume.flows.manager.create_volume [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Volume volume-03f58247-8525-40ef-b9c9-e0d3adad0fab (03f58247-8525-40ef-b9c9-e0d3adad0fab): created successfully Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7726c01-2fd8-46fd-b33e-edf8f73c63ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86028) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 28 20:33:24 devstack cinder-volume[86028]: DEBUG cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Flow 'volume_create_manager' (1436c0f3-5fb5-4d32-8fc4-0d675724cbee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86028) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 28 20:33:24 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-df896c6b-c54e-4855-b353-409d212c071f tempest-ProjectReaderTests-502124558 None] Created volume successfully. Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Acquiring lock "cinder-03f58247-8525-40ef-b9c9-e0d3adad0fab-delete_volume" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Lock "cinder-03f58247-8525-40ef-b9c9-e0d3adad0fab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Acquiring lock "cinder-quobyte-03f58247-8525-40ef-b9c9-e0d3adad0fab" by "delete_volume" {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Lock "cinder-quobyte-03f58247-8525-40ef-b9c9-e0d3adad0fab" acquired by "delete_volume" :: waited 0.017s {{(pid=86028) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6266883-e796-4bc1-b989-21b6e3ec2692]: (4, 'qcow2') {{(pid=87597) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:25 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab Aug 28 20:33:25 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:25 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab" returned: 0 in 0.344s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:25 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab Aug 28 20:33:25 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:25 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15/volume-03f58247-8525-40ef-b9c9-e0d3adad0fab" returned: 0 in 0.243s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Lock "cinder-quobyte-03f58247-8525-40ef-b9c9-e0d3adad0fab" released by "delete_volume" :: held 0.623s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG cinder.quota [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Created reservations ['572bba45-ac3a-4397-8db1-6cdc615108e6', '17591b5e-988f-46a8-bbed-03959e60bcd5', 'b2fdcecb-aecb-4427-846b-ff3dd8acb172', '765401f3-6bc4-445f-afd3-91aebc9155fb'] {{(pid=86028) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838': None} {{(pid=86028) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG cinder.volume.drivers.quobyte [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d4cf1a7a-4dd0-403a-aa34-91d51ec20838'] {{(pid=86028) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.lockutils [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86028) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 28 20:33:25 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 28 20:33:25 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15 Aug 28 20:33:25 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 28 20:33:26 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Aug 28 20:33:26 devstack cinder-volume[86028]: DEBUG oslo_concurrency.processutils [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ef613bcd6b5ce50fcf51f98456dbc15" returned: 0 in 0.241s {{(pid=86028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 28 20:33:26 devstack cinder-volume[86028]: DEBUG cinder.manager [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Notifying Schedulers of capabilities ... {{(pid=86028) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 28 20:33:26 devstack cinder-volume[86028]: INFO cinder.volume.manager [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Deleted volume successfully. Aug 28 20:33:26 devstack cinder-volume[86028]: DEBUG cinder.coordination [None req-1b90d0e3-4c6a-49c5-bfd2-360f164a0001 tempest-ProjectReaderTests-502124558 None] Lock "cinder-03f58247-8525-40ef-b9c9-e0d3adad0fab-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=86028) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 28 20:33:35 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:SELECT=89,cinder:INSERT=41,cinder:UPDATE=135,cinder:DELETE=10 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 28 20:33:36 devstack cinder-volume[86028]: DEBUG dbcounter [-] [86028] Writing DB stats cinder:UPDATE=132,cinder:SELECT=106,cinder:INSERT=29,cinder:DELETE=13 {{(pid=86028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}